2026-03-28 10:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 10:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 10:35:05 [auto1.de] INFO: Batch mode enabled: batch 2/2
2026-03-28 10:35:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-28 10:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 10:35:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 10:35:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 10:35:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 10:35:05 [scrapy.extensions.telnet] INFO: Telnet Password: 0aaf66a8e6a5df79
2026-03-28 10:35:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 10:35:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_18_2026-03-28T10_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 10:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 10:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 10:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 10:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 10:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 10:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2113
2026-03-28 10:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 10:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 10:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 10:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 10:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 10:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 10:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-28 10:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 10:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6025
2026-03-28 10:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-28 10:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 10:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-28 10:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 10:35:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 10:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 10:35:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 10:35:54 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 9626 | hits on page: 40
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG46200%27 HTTP/1.1" 200 None
2026-03-28 10:35:54 [auto1.de] INFO: Scrape type for DG46200: 1
2026-03-28 10:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:54 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-28 10:35:54 [auto1.de] INFO: Scrape type for BU17582: 2
2026-03-28 10:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582
2026-03-28 10:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with scrape type 2
2026-03-28 10:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with scrape type 2
2026-03-28 10:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc, identifier: BU17582
2026-03-28 10:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 10:35:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 10:35:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582
2026-03-28 10:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc with identifier: BU17582 to the API
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:54:20Z',
 'fuel_type': 'petrol',
 'id': 'ad878d9e-b91e-5b5b-a2bf-8e7d9b7951dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU17582',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 67413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-16',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2019}
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [auto1.de] INFO: Saving data for BU17582: {'auction_closing_time': 1774886060.0, 'created_time': 1774033778.877449, 'last_price_update_time': 1774694155.104749}
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU17582') HTTP/1.1" 204 0
2026-03-28 10:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN71880%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [auto1.de] INFO: Scrape type for HN71880: 1
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [auto1.de] INFO: Scrape type for UT62888: 2
2026-03-28 10:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888
2026-03-28 10:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65718b7a-816f-50fb-9360-dbd5b4eeb25f with scrape type 2
2026-03-28 10:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65718b7a-816f-50fb-9360-dbd5b4eeb25f with scrape type 2
2026-03-28 10:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65718b7a-816f-50fb-9360-dbd5b4eeb25f, identifier: UT62888
2026-03-28 10:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 10:35:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 10:35:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888
2026-03-28 10:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65718b7a-816f-50fb-9360-dbd5b4eeb25f with identifier: UT62888 to the API
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:39:12Z',
 'fuel_type': 'diesel',
 'id': '65718b7a-816f-50fb-9360-dbd5b4eeb25f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT62888',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 114198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 110 CDI FWD lang',
 'transmission': 'automatic',
 'trim': 'FWD lang',
 'year': 2021}
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [auto1.de] INFO: Saving data for UT62888: {'auction_closing_time': 1774885152.0, 'created_time': 1774380418.96552, 'last_price_update_time': 1774694155.953305}
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT62888') HTTP/1.1" 204 0
2026-03-28 10:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN24608%27 HTTP/1.1" 200 None
2026-03-28 10:35:55 [auto1.de] INFO: Scrape type for CN24608: 1
2026-03-28 10:35:55 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE39564%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [auto1.de] INFO: Scrape type for BE39564: 1
2026-03-28 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV82579%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [auto1.de] INFO: Scrape type for WV82579: 1
2026-03-28 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [auto1.de] INFO: Scrape type for ZP80469: 2
2026-03-28 10:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469
2026-03-28 10:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54f9a65b-b0b4-5940-8897-00099051e33e with scrape type 2
2026-03-28 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54f9a65b-b0b4-5940-8897-00099051e33e with scrape type 2
2026-03-28 10:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54f9a65b-b0b4-5940-8897-00099051e33e, identifier: ZP80469
2026-03-28 10:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469
2026-03-28 10:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469
2026-03-28 10:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54f9a65b-b0b4-5940-8897-00099051e33e with identifier: ZP80469 to the API
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:47:21Z',
 'fuel_type': 'petrol',
 'id': '54f9a65b-b0b4-5940-8897-00099051e33e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP80469',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 118029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.4 BoosterJet Comfort + 4x4',
 'transmission': 'automatic',
 'trim': 'Comfort + 4x4',
 'year': 2018}
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [auto1.de] INFO: Saving data for ZP80469: {'auction_closing_time': 1774885641.0, 'created_time': 1773381260.065967, 'last_price_update_time': 1774694156.52706}
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP80469') HTTP/1.1" 204 0
2026-03-28 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW56448%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [auto1.de] INFO: Scrape type for CW56448: 1
2026-03-28 10:35:56 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-28 10:35:56 [auto1.de] INFO: Scrape type for DL34972: 2
2026-03-28 10:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972
2026-03-28 10:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df46b9d6-a35b-5d8f-b100-3abb90134705 with scrape type 2
2026-03-28 10:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df46b9d6-a35b-5d8f-b100-3abb90134705 with scrape type 2
2026-03-28 10:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df46b9d6-a35b-5d8f-b100-3abb90134705, identifier: DL34972
2026-03-28 10:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 10:35:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972
2026-03-28 10:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df46b9d6-a35b-5d8f-b100-3abb90134705 with identifier: DL34972 to the API
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:03:17Z',
 'fuel_type': 'petrol',
 'id': 'df46b9d6-a35b-5d8f-b100-3abb90134705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL34972',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 161127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-02',
 'seller_name': None,
 'title': 'Hyundai i40 1.6 Trend Blue',
 'transmission': 'manual',
 'trim': 'Trend Blue',
 'year': 2017}
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Saving data for DL34972: {'auction_closing_time': 1774882997.0, 'created_time': 1773427051.394267, 'last_price_update_time': 1774694157.244556}
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL34972') HTTP/1.1" 204 0
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD10006%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Scrape type for ZD10006: 1
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32904%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Scrape type for FX32904: 1
2026-03-28 10:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB79978%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Scrape type for PB79978: 1
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18437%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Scrape type for SX18437: 1
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-28 10:35:57 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-28 10:35:57 [auto1.de] INFO: Scrape type for GF30877: 2
2026-03-28 10:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877
2026-03-28 10:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with scrape type 2
2026-03-28 10:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with scrape type 2
2026-03-28 10:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9, identifier: GF30877
2026-03-28 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 10:35:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877
2026-03-28 10:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3a6b116-b784-5c90-b66e-ba9ca30b5cf9 with identifier: GF30877 to the API
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:32Z',
 'fuel_type': 'diesel',
 'id': 'e3a6b116-b784-5c90-b66e-ba9ca30b5cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF30877',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 125395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-25',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [auto1.de] INFO: Saving data for GF30877: {'auction_closing_time': 1774884152.0, 'created_time': 1773946982.55872, 'last_price_update_time': 1774694158.028743}
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF30877') HTTP/1.1" 204 0
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [auto1.de] INFO: Scrape type for CD84483: 2
2026-03-28 10:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483
2026-03-28 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with scrape type 2
2026-03-28 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with scrape type 2
2026-03-28 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb, identifier: CD84483
2026-03-28 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483
2026-03-28 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483
2026-03-28 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb with identifier: CD84483 to the API
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:49Z',
 'fuel_type': 'diesel',
 'id': 'e101ba3c-90c9-5c5c-8ecf-c79eaaa6a9bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD84483',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 191041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-20',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [auto1.de] INFO: Saving data for CD84483: {'auction_closing_time': 1774885309.0, 'created_time': 1773383273.43793, 'last_price_update_time': 1774694158.614793}
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD84483') HTTP/1.1" 204 0
2026-03-28 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG46200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN71880/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-28 10:35:58 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-28 10:35:58 [auto1.de] INFO: Scrape type for GM88868: 2
2026-03-28 10:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868
2026-03-28 10:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with scrape type 2
2026-03-28 10:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with scrape type 2
2026-03-28 10:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9, identifier: GM88868
2026-03-28 10:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868
2026-03-28 10:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868
2026-03-28 10:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7129dd7-5d9c-58fd-a786-ca35f83a0ec9 with identifier: GM88868 to the API
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:39:52Z',
 'fuel_type': 'diesel',
 'id': 'c7129dd7-5d9c-58fd-a786-ca35f83a0ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM88868',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce Verso',
 'odometer': 122558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-26',
 'seller_name': None,
 'title': 'Toyota ProAce Verso 2.0 D-4D L1 Family Comfort',
 'transmission': 'automatic',
 'trim': 'L1 Family Comfort',
 'year': 2021}
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-28 10:35:59 [auto1.de] INFO: Saving data for GM88868: {'auction_closing_time': 1774885192.0, 'created_time': 1773401101.469245, 'last_price_update_time': 1774694159.062702}
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM88868') HTTP/1.1" 204 0
2026-03-28 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WV82579/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BE39564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:35:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX32904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CN24608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW56448/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:03 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 9626 | hits on page: 40
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-28 10:36:03 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/DG46200/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Scrape type for BU17582: 0
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Scrape type for UT62888: 0
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Scrape type for ZP80469: 0
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Scrape type for DL34972: 0
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Scrape type for GF30877: 0
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Scrape type for CD84483: 0
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-28 10:36:03 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-28 10:36:03 [auto1.de] INFO: Scrape type for GM88868: 0
2026-03-28 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG46200> (referer: https://www.auto1.com/v1/car-details-view/DG46200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-03-28 10:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a72b18-588d-5085-b89f-6448e85a5c91 with scrape type 1
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9a72b18-588d-5085-b89f-6448e85a5c91
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_c90fcbdb2fa7c857929ef9f6c5c2f193.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c90fcbdb2fa7c857929ef9f6c5c2f193.jpg already downloaded
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_c3c56392b3d46bf0001938e8a976ce02.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c3c56392b3d46bf0001938e8a976ce02.jpg already downloaded
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_f666844c5b553514343d92d94afa0a0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_f666844c5b553514343d92d94afa0a0b.jpg already downloaded
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_91e35339bbcae5db063487d6c8720c5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_91e35339bbcae5db063487d6c8720c5d.jpg already downloaded
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_d39ed45b717f0ffc80dea2db4c8ea64c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_d39ed45b717f0ffc80dea2db4c8ea64c.jpg already downloaded
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_c9d6bfb0c691257f8fe4e1a6b409a422.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c9d6bfb0c691257f8fe4e1a6b409a422.jpg already downloaded
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_79b31d68042f6905374d523a99e98d3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_79b31d68042f6905374d523a99e98d3d.jpg already downloaded
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_37ead82a943d8520f67fc323d9bdd90b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_37ead82a943d8520f67fc323d9bdd90b.jpg already downloaded
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_64f7eabc0fa73b7c580bb78a62553058.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_64f7eabc0fa73b7c580bb78a62553058.jpg already downloaded
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Fc4%252Fffc477d41a979abc8e1326182c16dbf2%252Fpa%252FDG46200_cf3729369ea8e520c45f77a24fca216b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_cf3729369ea8e520c45f77a24fca216b.jpg already downloaded
2026-03-28 10:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9a72b18-588d-5085-b89f-6448e85a5c91, identifier: DG46200
2026-03-28 10:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-03-28 10:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200
2026-03-28 10:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9a72b18-588d-5085-b89f-6448e85a5c91 with identifier: DG46200 to the API
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DG46200>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:46:51Z',
 'fuel_type': 'petrol',
 'id': 'a9a72b18-588d-5085-b89f-6448e85a5c91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG46200',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'BMW',
 'model': '5er',
 'odometer': 159787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c90fcbdb2fa7c857929ef9f6c5c2f193.jpg',
                'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c3c56392b3d46bf0001938e8a976ce02.jpg',
                'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_f666844c5b553514343d92d94afa0a0b.jpg',
                'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_91e35339bbcae5db063487d6c8720c5d.jpg',
                'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_d39ed45b717f0ffc80dea2db4c8ea64c.jpg',
                'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c9d6bfb0c691257f8fe4e1a6b409a422.jpg',
                'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_79b31d68042f6905374d523a99e98d3d.jpg',
                'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_37ead82a943d8520f67fc323d9bdd90b.jpg',
                'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_64f7eabc0fa73b7c580bb78a62553058.jpg',
                'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_cf3729369ea8e520c45f77a24fca216b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c90fcbdb2fa7c857929ef9f6c5c2f193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c3c56392b3d46bf0001938e8a976ce02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_f666844c5b553514343d92d94afa0a0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_91e35339bbcae5db063487d6c8720c5d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2880258,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_d39ed45b717f0ffc80dea2db4c8ea64c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056033,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_c9d6bfb0c691257f8fe4e1a6b409a422.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_79b31d68042f6905374d523a99e98d3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_37ead82a943d8520f67fc323d9bdd90b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_64f7eabc0fa73b7c580bb78a62553058.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9a72b18-588d-5085-b89f-6448e85a5c91/a9a72b18-588d-5085-b89f-6448e85a5c91_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056203,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/c4/ffc477d41a979abc8e1326182c16dbf2/pa/DG46200_cf3729369ea8e520c45f77a24fca216b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 528i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG46200%27 HTTP/1.1" 200 None
2026-03-28 10:36:05 [auto1.de] INFO: Saving data for DG46200: {'created_time': 1774694165.857857, 'last_price_update_time': 1774694165.857868, 'auction_closing_time': 1774885611.0}
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG46200') HTTP/1.1" 204 0
2026-03-28 10:36:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BE39564> (referer: https://www.auto1.com/v1/car-details-view/BE39564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564
2026-03-28 10:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dae1123b-22f1-50a4-9708-3b1358d76717 with scrape type 1
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_e401ecd31c049912eb4ba00773c082a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_e401ecd31c049912eb4ba00773c082a4.jpg not downloaded yet
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_5412c9847413fd62e9cabcb72f1b000b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_5412c9847413fd62e9cabcb72f1b000b.jpg not downloaded yet
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_a2a4efe406e3571ef88f4a408ee6b85c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_a2a4efe406e3571ef88f4a408ee6b85c.jpg not downloaded yet
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_11b44e305fb5f8831f6e469d6d9963e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_11b44e305fb5f8831f6e469d6d9963e9.jpg not downloaded yet
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_abed29068b72a8b40a6ccf7a756c10e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_abed29068b72a8b40a6ccf7a756c10e8.jpg not downloaded yet
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_c5b794fa8dd75d354dcca37d6513bf10.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_c5b794fa8dd75d354dcca37d6513bf10.jpg not downloaded yet
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_ef2ec058064af2e25742db124b6ed4bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_ef2ec058064af2e25742db124b6ed4bf.jpg not downloaded yet
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_0d20b297d351986369ae38b58cc1e654.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_0d20b297d351986369ae38b58cc1e654.jpg not downloaded yet
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_437544db830f8208595e91d381a20f0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_437544db830f8208595e91d381a20f0d.jpg not downloaded yet
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_3a62e947f61c9f586adafb14d955d14d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_3a62e947f61c9f586adafb14d955d14d.jpg not downloaded yet
2026-03-28 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_e401ecd31c049912eb4ba00773c082a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:06 [scrapy.extensions.logstats] INFO: Crawled 15 pages (at 15 pages/min), scraped 8 items (at 8 items/min)
2026-03-28 10:36:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 162MiB
2026-03-28 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_3a62e947f61c9f586adafb14d955d14d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_c5b794fa8dd75d354dcca37d6513bf10.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_5412c9847413fd62e9cabcb72f1b000b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_a2a4efe406e3571ef88f4a408ee6b85c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_ef2ec058064af2e25742db124b6ed4bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89136d0>
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2123
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_e401ecd31c049912eb4ba00773c082a4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_e401ecd31c049912eb4ba00773c082a4.jpg saved to cache
2026-03-28 10:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf35ad0>
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_3a62e947f61c9f586adafb14d955d14d.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_3a62e947f61c9f586adafb14d955d14d.jpg saved to cache
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe29f90>
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_c5b794fa8dd75d354dcca37d6513bf10.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_c5b794fa8dd75d354dcca37d6513bf10.jpg saved to cache
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe37bd0>
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_5412c9847413fd62e9cabcb72f1b000b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_5412c9847413fd62e9cabcb72f1b000b.jpg saved to cache
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe30890>
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_a2a4efe406e3571ef88f4a408ee6b85c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_a2a4efe406e3571ef88f4a408ee6b85c.jpg saved to cache
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe46a50>
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_ef2ec058064af2e25742db124b6ed4bf.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_ef2ec058064af2e25742db124b6ed4bf.jpg saved to cache
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW56448> (referer: https://www.auto1.com/v1/car-details-view/CW56448/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_11b44e305fb5f8831f6e469d6d9963e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_abed29068b72a8b40a6ccf7a756c10e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_437544db830f8208595e91d381a20f0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448
2026-03-28 10:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6249825-b358-5ffd-997c-66c5ec00f94d with scrape type 1
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6249825-b358-5ffd-997c-66c5ec00f94d
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_ba42223e31058b2e172c3bc3f99bd66d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_ba42223e31058b2e172c3bc3f99bd66d.jpg already downloaded
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_9ef95650180384fde38f0560fcf7d35c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_9ef95650180384fde38f0560fcf7d35c.jpg already downloaded
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_9062fea5fa233b00466bede491efbdb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_9062fea5fa233b00466bede491efbdb0.jpg already downloaded
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_258d3f3c14b1dee2eb962bde5ccb5c3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_258d3f3c14b1dee2eb962bde5ccb5c3a.jpg already downloaded
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_18fa4368057fd8b1d431b782a8271e4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_18fa4368057fd8b1d431b782a8271e4c.jpg already downloaded
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_be54a84fc6a432bf91e86fcc64facf5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_be54a84fc6a432bf91e86fcc64facf5f.jpg already downloaded
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_9892ee91ba55f56cbd50e4d1ace867cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_9892ee91ba55f56cbd50e4d1ace867cd.jpg already downloaded
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_2821a9ec300b1c569670304b7f51d810.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_2821a9ec300b1c569670304b7f51d810.jpg already downloaded
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_6fcff7a915c84a520b5ef34c10f6b7c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_6fcff7a915c84a520b5ef34c10f6b7c5.jpg already downloaded
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252Fc0%252F5bc01a495236930eacf08f628500f500%252Fpa%252FCW56448_3af7b09a0a65cd8a6a2edb1b6650a79b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_3af7b09a0a65cd8a6a2edb1b6650a79b.jpg already downloaded
2026-03-28 10:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6249825-b358-5ffd-997c-66c5ec00f94d, identifier: CW56448
2026-03-28 10:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 10:36:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448
2026-03-28 10:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6249825-b358-5ffd-997c-66c5ec00f94d with identifier: CW56448 to the API
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CW56448>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:40:55Z',
 'fuel_type': 'diesel',
 'id': 'c6249825-b358-5ffd-997c-66c5ec00f94d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW56448',
 'listing': 'auction',
 'location': 'DE, Wilhelmshaven',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 80034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_ba42223e31058b2e172c3bc3f99bd66d.jpg',
                'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_9ef95650180384fde38f0560fcf7d35c.jpg',
                'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_9062fea5fa233b00466bede491efbdb0.jpg',
                'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_258d3f3c14b1dee2eb962bde5ccb5c3a.jpg',
                'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_18fa4368057fd8b1d431b782a8271e4c.jpg',
                'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_be54a84fc6a432bf91e86fcc64facf5f.jpg',
                'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_9892ee91ba55f56cbd50e4d1ace867cd.jpg',
                'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_2821a9ec300b1c569670304b7f51d810.jpg',
                'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_6fcff7a915c84a520b5ef34c10f6b7c5.jpg',
                'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_3af7b09a0a65cd8a6a2edb1b6650a79b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_ba42223e31058b2e172c3bc3f99bd66d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2722260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_9ef95650180384fde38f0560fcf7d35c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_9062fea5fa233b00466bede491efbdb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_258d3f3c14b1dee2eb962bde5ccb5c3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670455,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_18fa4368057fd8b1d431b782a8271e4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_be54a84fc6a432bf91e86fcc64facf5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_9892ee91ba55f56cbd50e4d1ace867cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2802015,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_2821a9ec300b1c569670304b7f51d810.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_6fcff7a915c84a520b5ef34c10f6b7c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6249825-b358-5ffd-997c-66c5ec00f94d/c6249825-b358-5ffd-997c-66c5ec00f94d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/c0/5bc01a495236930eacf08f628500f500/pa/CW56448_3af7b09a0a65cd8a6a2edb1b6650a79b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi 360',
 'transmission': 'automatic',
 'trim': '360',
 'year': 2015}
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW56448%27 HTTP/1.1" 200 None
2026-03-28 10:36:08 [auto1.de] INFO: Saving data for CW56448: {'created_time': 1774694168.496588, 'last_price_update_time': 1774694168.4966, 'auction_closing_time': 1774885255.0}
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW56448') HTTP/1.1" 204 0
2026-03-28 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB79978/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5ad90>
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_11b44e305fb5f8831f6e469d6d9963e9.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_11b44e305fb5f8831f6e469d6d9963e9.jpg saved to cache
2026-03-28 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf89810>
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_abed29068b72a8b40a6ccf7a756c10e8.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_abed29068b72a8b40a6ccf7a756c10e8.jpg saved to cache
2026-03-28 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf8ef90>
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_437544db830f8208595e91d381a20f0d.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_437544db830f8208595e91d381a20f0d.jpg saved to cache
2026-03-28 10:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_0d20b297d351986369ae38b58cc1e654.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf96d50>
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg49%252Fe7%252F49e7578ab6554b4e65c87bac22c4c490%252Fpa%252FBE39564_0d20b297d351986369ae38b58cc1e654.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_0d20b297d351986369ae38b58cc1e654.jpg saved to cache
2026-03-28 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dae1123b-22f1-50a4-9708-3b1358d76717
2026-03-28 10:36:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dae1123b-22f1-50a4-9708-3b1358d76717, skipping ID generation
2026-03-28 10:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dae1123b-22f1-50a4-9708-3b1358d76717 with scrape type 1
2026-03-28 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dae1123b-22f1-50a4-9708-3b1358d76717 sending to next pipeline
2026-03-28 10:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dae1123b-22f1-50a4-9708-3b1358d76717, identifier: BE39564
2026-03-28 10:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564
2026-03-28 10:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564
2026-03-28 10:36:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dae1123b-22f1-50a4-9708-3b1358d76717 with identifier: BE39564 to the API
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_0d20b297d351986369ae38b58cc1e654.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:52:33Z',
 'fuel_type': 'diesel',
 'id': 'dae1123b-22f1-50a4-9708-3b1358d76717',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE39564',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 347895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2970750,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_e401ecd31c049912eb4ba00773c082a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69941,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_5412c9847413fd62e9cabcb72f1b000b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_a2a4efe406e3571ef88f4a408ee6b85c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2974901,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_11b44e305fb5f8831f6e469d6d9963e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2983817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_abed29068b72a8b40a6ccf7a756c10e8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3030162,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_c5b794fa8dd75d354dcca37d6513bf10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_ef2ec058064af2e25742db124b6ed4bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3013741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_0d20b297d351986369ae38b58cc1e654.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2968941,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_437544db830f8208595e91d381a20f0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dae1123b-22f1-50a4-9708-3b1358d76717/dae1123b-22f1-50a4-9708-3b1358d76717_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2854243,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img49/e7/49e7578ab6554b4e65c87bac22c4c490/pa/BE39564_3a62e947f61c9f586adafb14d955d14d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 D3 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2014}
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE39564%27 HTTP/1.1" 200 None
2026-03-28 10:36:09 [auto1.de] INFO: Saving data for BE39564: {'created_time': 1774694169.601926, 'last_price_update_time': 1774694169.60194, 'auction_closing_time': 1774885953.0}
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE39564') HTTP/1.1" 204 0
2026-03-28 10:36:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:09 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 9626 | hits on page: 40
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT60125%27 HTTP/1.1" 200 None
2026-03-28 10:36:09 [auto1.de] INFO: Scrape type for AT60125: 1
2026-03-28 10:36:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA47251%27 HTTP/1.1" 200 None
2026-03-28 10:36:09 [auto1.de] INFO: Scrape type for WA47251: 1
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64872%27 HTTP/1.1" 200 None
2026-03-28 10:36:09 [auto1.de] INFO: Scrape type for RC64872: 1
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-28 10:36:09 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV73009%27 HTTP/1.1" 200 None
2026-03-28 10:36:09 [auto1.de] INFO: Scrape type for GV73009: 2
2026-03-28 10:36:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009
2026-03-28 10:36:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b835a100-c137-5ebc-a5a4-6858cd247fdd with scrape type 2
2026-03-28 10:36:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b835a100-c137-5ebc-a5a4-6858cd247fdd with scrape type 2
2026-03-28 10:36:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b835a100-c137-5ebc-a5a4-6858cd247fdd, identifier: GV73009
2026-03-28 10:36:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009
2026-03-28 10:36:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009
2026-03-28 10:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b835a100-c137-5ebc-a5a4-6858cd247fdd with identifier: GV73009 to the API
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:00Z',
 'fuel_type': 'petrol',
 'id': 'b835a100-c137-5ebc-a5a4-6858cd247fdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV73009',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 65735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-22',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV73009%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Saving data for GV73009: {'auction_closing_time': 1774882920.0, 'created_time': 1774002126.769679, 'last_price_update_time': 1774694170.289681}
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV73009') HTTP/1.1" 204 0
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63291%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Scrape type for SR63291: 2
2026-03-28 10:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291
2026-03-28 10:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with scrape type 2
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with scrape type 2
2026-03-28 10:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe, identifier: SR63291
2026-03-28 10:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291
2026-03-28 10:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291
2026-03-28 10:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7348ca3-e5e5-50cf-bd19-bbcfd3215afe with identifier: SR63291 to the API
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:03:52Z',
 'fuel_type': 'petrol',
 'id': 'd7348ca3-e5e5-50cf-bd19-bbcfd3215afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR63291',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 97387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-15',
 'seller_name': None,
 'title': 'Fiat 500C 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63291%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Saving data for SR63291: {'auction_closing_time': 1774883032.0, 'created_time': 1774032247.76233, 'last_price_update_time': 1774694170.825396}
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR63291') HTTP/1.1" 204 0
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP03101%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Scrape type for EP03101: 1
2026-03-28 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CN24608> (referer: https://www.auto1.com/v1/car-details-view/CN24608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA64256%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Scrape type for HA64256: 1
2026-03-28 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX32904> (referer: https://www.auto1.com/v1/car-details-view/FX32904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB79978> (referer: https://www.auto1.com/v1/car-details-view/PB79978/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WV82579> (referer: https://www.auto1.com/v1/car-details-view/WV82579/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH34221%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Scrape type for BH34221: 1
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: HP25742
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP25742%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Scrape type for HP25742: 1
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-28 10:36:10 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT22331%27 HTTP/1.1" 200 None
2026-03-28 10:36:10 [auto1.de] INFO: Scrape type for PT22331: 2
2026-03-28 10:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331
2026-03-28 10:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f153be52-7eed-5477-8858-c6eb7905279c with scrape type 2
2026-03-28 10:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f153be52-7eed-5477-8858-c6eb7905279c with scrape type 2
2026-03-28 10:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f153be52-7eed-5477-8858-c6eb7905279c, identifier: PT22331
2026-03-28 10:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331
2026-03-28 10:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331
2026-03-28 10:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f153be52-7eed-5477-8858-c6eb7905279c with identifier: PT22331 to the API
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:43:51Z',
 'fuel_type': 'petrol',
 'id': 'f153be52-7eed-5477-8858-c6eb7905279c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT22331',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 132789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2013}
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT22331%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [auto1.de] INFO: Saving data for PT22331: {'auction_closing_time': 1774885431.0, 'created_time': 1773398777.031536, 'last_price_update_time': 1774694171.39484}
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT22331') HTTP/1.1" 204 0
2026-03-28 10:36:11 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-28 10:36:11 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-28 10:36:11 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC15764%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [auto1.de] INFO: Scrape type for BC15764: 1
2026-03-28 10:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608
2026-03-28 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with scrape type 1
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_7db4949632dbaf4447fde8fed8081495.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_7db4949632dbaf4447fde8fed8081495.jpg not downloaded yet
2026-03-28 10:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904
2026-03-28 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a13b29-1f3b-5e38-82de-d63f81df926d with scrape type 1
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 83a13b29-1f3b-5e38-82de-d63f81df926d
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_a928da2b3d7017a71dd15c3878ec240e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_a928da2b3d7017a71dd15c3878ec240e.jpg not downloaded yet
2026-03-28 10:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978
2026-03-28 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with scrape type 1
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_91ca174b12b437547d8f58525026e4a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_91ca174b12b437547d8f58525026e4a1.jpg not downloaded yet
2026-03-28 10:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579
2026-03-28 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with scrape type 1
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_0d56bf5893538982162c22dceb98c02a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_0d56bf5893538982162c22dceb98c02a.jpg not downloaded yet
2026-03-28 10:36:11 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW82863%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [auto1.de] INFO: Scrape type for YW82863: 1
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_7f9a455e786ecb903259fc1c487311b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_7f9a455e786ecb903259fc1c487311b4.jpg not downloaded yet
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_9502398b1ac3af6134e26cfc9c68835e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_9502398b1ac3af6134e26cfc9c68835e.jpg not downloaded yet
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_eecf49acce334e621fbb919808e42b21.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_eecf49acce334e621fbb919808e42b21.jpg not downloaded yet
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_94b75fd9cb4068277de5a2e3e544c74e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_94b75fd9cb4068277de5a2e3e544c74e.jpg not downloaded yet
2026-03-28 10:36:11 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37862%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [auto1.de] INFO: Scrape type for AR37862: 1
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_b775adbdd551a9dfa9505ae074b4b3ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_b775adbdd551a9dfa9505ae074b4b3ff.jpg not downloaded yet
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_fd026a3dba1fb88b3221ad9a1229e918.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_fd026a3dba1fb88b3221ad9a1229e918.jpg not downloaded yet
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_888fa0506797c4732d3cada64c987f2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_888fa0506797c4732d3cada64c987f2a.jpg not downloaded yet
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_dbf477035d70cee5e1b2c0d3b0288497.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_dbf477035d70cee5e1b2c0d3b0288497.jpg not downloaded yet
2026-03-28 10:36:11 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR83794%27 HTTP/1.1" 200 None
2026-03-28 10:36:11 [auto1.de] INFO: Scrape type for XR83794: 2
2026-03-28 10:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794
2026-03-28 10:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9f36d93-22b3-5f7b-bc96-916d6060ce90 with scrape type 2
2026-03-28 10:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9f36d93-22b3-5f7b-bc96-916d6060ce90 with scrape type 2
2026-03-28 10:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9f36d93-22b3-5f7b-bc96-916d6060ce90, identifier: XR83794
2026-03-28 10:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794
2026-03-28 10:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794
2026-03-28 10:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9f36d93-22b3-5f7b-bc96-916d6060ce90 with identifier: XR83794 to the API
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:34:50Z',
 'fuel_type': 'diesel',
 'id': 'd9f36d93-22b3-5f7b-bc96-916d6060ce90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR83794',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 233592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-22',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR83794%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [auto1.de] INFO: Saving data for XR83794: {'auction_closing_time': 1774884890.0, 'created_time': 1773382492.08787, 'last_price_update_time': 1774694172.31178}
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR83794') HTTP/1.1" 204 0
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_f0249e1d8f14870d7bb3bf7cef67bbc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_f0249e1d8f14870d7bb3bf7cef67bbc5.jpg not downloaded yet
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_9836ef0648e8b495d5a8d1e83f1d718e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_9836ef0648e8b495d5a8d1e83f1d718e.jpg not downloaded yet
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_d30005b92f363b21f619ae1e6a1e0d10.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_d30005b92f363b21f619ae1e6a1e0d10.jpg not downloaded yet
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_00602018f9ad6efadcf0ee2e94332ff5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_00602018f9ad6efadcf0ee2e94332ff5.jpg not downloaded yet
2026-03-28 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_91ca174b12b437547d8f58525026e4a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:12 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM55805%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [auto1.de] INFO: Scrape type for DM55805: 1
2026-03-28 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_0d56bf5893538982162c22dceb98c02a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_a928da2b3d7017a71dd15c3878ec240e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_b66f83f2aa5b305a12c3ea504cdfe5be.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_b66f83f2aa5b305a12c3ea504cdfe5be.jpg not downloaded yet
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_6409671c0b326dce4744fb5f35bcf81b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_6409671c0b326dce4744fb5f35bcf81b.jpg not downloaded yet
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_d53f394094d9b743a6e290bfd8d81a49.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_d53f394094d9b743a6e290bfd8d81a49.jpg not downloaded yet
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_ee39957ceb3f7a24868553a35946736c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_ee39957ceb3f7a24868553a35946736c.jpg not downloaded yet
2026-03-28 10:36:12 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-28 10:36:12 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-28 10:36:12 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-28 10:36:12 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-28 10:36:12 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR74031%27 HTTP/1.1" 200 None
2026-03-28 10:36:12 [auto1.de] INFO: Scrape type for BR74031: 2
2026-03-28 10:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031
2026-03-28 10:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3798b733-219f-5dc5-ab2f-2667d938148a with scrape type 2
2026-03-28 10:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3798b733-219f-5dc5-ab2f-2667d938148a with scrape type 2
2026-03-28 10:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3798b733-219f-5dc5-ab2f-2667d938148a, identifier: BR74031
2026-03-28 10:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 10:36:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031
2026-03-28 10:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3798b733-219f-5dc5-ab2f-2667d938148a with identifier: BR74031 to the API
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:02Z',
 'fuel_type': 'petrol',
 'id': '3798b733-219f-5dc5-ab2f-2667d938148a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR74031',
 'listing': 'auction',
 'make': 'Audi',
 'model': '80',
 'odometer': 188538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1987-12-09',
 'seller_name': None,
 'title': 'Audi 80 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1987}
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR74031%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [auto1.de] INFO: Saving data for BR74031: {'auction_closing_time': 1774886102.0, 'created_time': 1774118691.729781, 'last_price_update_time': 1774694173.059486}
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR74031') HTTP/1.1" 204 0
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_891c74bb7860b02d852792e703b29d3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_891c74bb7860b02d852792e703b29d3b.jpg not downloaded yet
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_f7dc0405008c846ec41c6119d089d643.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_f7dc0405008c846ec41c6119d089d643.jpg not downloaded yet
2026-03-28 10:36:13 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-28 10:36:13 [auto1.de] INFO: Found listing with ID: PB91995
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB91995%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [auto1.de] INFO: Scrape type for PB91995: 1
2026-03-28 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_9836ef0648e8b495d5a8d1e83f1d718e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_fca113d9bee88ea8f3ad3cd6eeca64f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_fca113d9bee88ea8f3ad3cd6eeca64f9.jpg not downloaded yet
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_9f826a3b61c856f0dce20174f84480f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_9f826a3b61c856f0dce20174f84480f8.jpg not downloaded yet
2026-03-28 10:36:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA47251/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT60125/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:13 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG46471%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [auto1.de] INFO: Scrape type for ZG46471: 2
2026-03-28 10:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471
2026-03-28 10:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bcd83c-a27a-55fa-984e-91e5916927ba with scrape type 2
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2bcd83c-a27a-55fa-984e-91e5916927ba with scrape type 2
2026-03-28 10:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2bcd83c-a27a-55fa-984e-91e5916927ba, identifier: ZG46471
2026-03-28 10:36:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe9bd10>
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_91ca174b12b437547d8f58525026e4a1.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_91ca174b12b437547d8f58525026e4a1.jpg saved to cache
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ba250>
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_0d56bf5893538982162c22dceb98c02a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_0d56bf5893538982162c22dceb98c02a.jpg saved to cache
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabff5550>
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_a928da2b3d7017a71dd15c3878ec240e.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_a928da2b3d7017a71dd15c3878ec240e.jpg saved to cache
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 83a13b29-1f3b-5e38-82de-d63f81df926d
2026-03-28 10:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471
2026-03-28 10:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471
2026-03-28 10:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2bcd83c-a27a-55fa-984e-91e5916927ba with identifier: ZG46471 to the API
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:00:37Z',
 'fuel_type': 'petrol',
 'id': 'b2bcd83c-a27a-55fa-984e-91e5916927ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG46471',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Orlando',
 'odometer': 113922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-01',
 'seller_name': None,
 'title': 'Chevrolet Orlando 1.8 LT',
 'transmission': 'manual',
 'trim': 'LT',
 'year': 2012}
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG46471%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [auto1.de] INFO: Saving data for ZG46471: {'auction_closing_time': 1774882837.0, 'created_time': 1774035345.555718, 'last_price_update_time': 1774694173.880672}
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG46471') HTTP/1.1" 204 0
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_5e1d923a6de70eda29c1b0a5db5d242d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_5e1d923a6de70eda29c1b0a5db5d242d.jpg not downloaded yet
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_37e4b8352722cc6fea4af53452e3a9fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_37e4b8352722cc6fea4af53452e3a9fd.jpg not downloaded yet
2026-03-28 10:36:13 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR61272%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [auto1.de] INFO: Scrape type for ZR61272: 1
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_c4403434538e7c0a37d0370bae4f6bfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_c4403434538e7c0a37d0370bae4f6bfb.jpg not downloaded yet
2026-03-28 10:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_8b502cf21e229f570a8bf9fe2f8c13c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_8b502cf21e229f570a8bf9fe2f8c13c8.jpg not downloaded yet
2026-03-28 10:36:14 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 9627 | hits on page: 40
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe28090>
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_9836ef0648e8b495d5a8d1e83f1d718e.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_9836ef0648e8b495d5a8d1e83f1d718e.jpg saved to cache
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 83a13b29-1f3b-5e38-82de-d63f81df926d
2026-03-28 10:36:14 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-28 10:36:14 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-28 10:36:14 [auto1.de] INFO: Scrape type for YU16554: 2
2026-03-28 10:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554
2026-03-28 10:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 984a1914-17a6-5a58-b562-c04073490779 with scrape type 2
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 984a1914-17a6-5a58-b562-c04073490779 with scrape type 2
2026-03-28 10:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 984a1914-17a6-5a58-b562-c04073490779, identifier: YU16554
2026-03-28 10:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 10:36:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554
2026-03-28 10:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 984a1914-17a6-5a58-b562-c04073490779 with identifier: YU16554 to the API
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:42:18Z',
 'fuel_type': 'diesel',
 'id': '984a1914-17a6-5a58-b562-c04073490779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU16554',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 192828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-28 10:36:14 [auto1.de] INFO: Saving data for YU16554: {'auction_closing_time': 1774885338.0, 'created_time': 1773946998.261386, 'last_price_update_time': 1774694174.731612}
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU16554') HTTP/1.1" 204 0
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_8f0ec9ac26f7df204000e820174dc0ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_8f0ec9ac26f7df204000e820174dc0ab.jpg not downloaded yet
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_8ffff17eb7ace9d701f7dd904845da8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_8ffff17eb7ace9d701f7dd904845da8c.jpg not downloaded yet
2026-03-28 10:36:14 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB66562%27 HTTP/1.1" 200 None
2026-03-28 10:36:14 [auto1.de] INFO: Scrape type for UB66562: 1
2026-03-28 10:36:14 [auto1.de] INFO: Found listing with ID: UD07606
2026-03-28 10:36:14 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-28 10:36:14 [auto1.de] INFO: Scrape type for PR78588: 2
2026-03-28 10:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588
2026-03-28 10:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9531b28b-a3bb-5142-8b97-7531dea6b329 with scrape type 2
2026-03-28 10:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9531b28b-a3bb-5142-8b97-7531dea6b329 with scrape type 2
2026-03-28 10:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9531b28b-a3bb-5142-8b97-7531dea6b329, identifier: PR78588
2026-03-28 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_891c74bb7860b02d852792e703b29d3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_ee39957ceb3f7a24868553a35946736c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588
2026-03-28 10:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588
2026-03-28 10:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9531b28b-a3bb-5142-8b97-7531dea6b329 with identifier: PR78588 to the API
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:58:41Z',
 'fuel_type': 'diesel',
 'id': '9531b28b-a3bb-5142-8b97-7531dea6b329',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR78588',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 225847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-10',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2014}
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-28 10:36:15 [auto1.de] INFO: Saving data for PR78588: {'auction_closing_time': 1774886321.0, 'created_time': 1774118964.206734, 'last_price_update_time': 1774694175.305062}
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR78588') HTTP/1.1" 204 0
2026-03-28 10:36:15 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-28 10:36:15 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-28 10:36:15 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY16606%27 HTTP/1.1" 200 None
2026-03-28 10:36:15 [auto1.de] INFO: Scrape type for DY16606: 1
2026-03-28 10:36:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD10006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:15 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-28 10:36:15 [auto1.de] INFO: Scrape type for RK30802: 2
2026-03-28 10:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802
2026-03-28 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with scrape type 2
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with scrape type 2
2026-03-28 10:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c, identifier: RK30802
2026-03-28 10:36:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802
2026-03-28 10:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802
2026-03-28 10:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c with identifier: RK30802 to the API
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'petrol',
 'id': '3d0b94df-5fcb-5445-a6a4-09d44dd2fb5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK30802',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 190674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-28 10:36:15 [auto1.de] INFO: Saving data for RK30802: {'auction_closing_time': 1774882807.0, 'created_time': 1774349927.690798, 'last_price_update_time': 1774694175.794965}
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK30802') HTTP/1.1" 204 0
2026-03-28 10:36:15 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90225%27 HTTP/1.1" 200 None
2026-03-28 10:36:15 [auto1.de] INFO: Scrape type for DK90225: 2
2026-03-28 10:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225
2026-03-28 10:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124e09ec-1c44-5b2e-b9b8-a61131db057c with scrape type 2
2026-03-28 10:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 124e09ec-1c44-5b2e-b9b8-a61131db057c with scrape type 2
2026-03-28 10:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 124e09ec-1c44-5b2e-b9b8-a61131db057c, identifier: DK90225
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-28 10:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225
2026-03-28 10:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225
2026-03-28 10:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 124e09ec-1c44-5b2e-b9b8-a61131db057c with identifier: DK90225 to the API
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:19:49Z',
 'fuel_type': 'diesel',
 'id': '124e09ec-1c44-5b2e-b9b8-a61131db057c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK90225',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 261565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-23',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Style AWD',
 'transmission': 'manual',
 'trim': 'Style AWD',
 'year': 2012}
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90225%27 HTTP/1.1" 200 None
2026-03-28 10:36:16 [auto1.de] INFO: Saving data for DK90225: {'auction_closing_time': 1774883989.0, 'created_time': 1774031875.673412, 'last_price_update_time': 1774694176.374105}
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK90225') HTTP/1.1" 204 0
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f0e10>
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_891c74bb7860b02d852792e703b29d3b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_891c74bb7860b02d852792e703b29d3b.jpg saved to cache
2026-03-28 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb8dd0>
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_ee39957ceb3f7a24868553a35946736c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_ee39957ceb3f7a24868553a35946736c.jpg saved to cache
2026-03-28 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC13380%27 HTTP/1.1" 200 None
2026-03-28 10:36:16 [auto1.de] INFO: Scrape type for MC13380: 2
2026-03-28 10:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380
2026-03-28 10:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f744190-c74d-5c3b-9391-86d742611d60 with scrape type 2
2026-03-28 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f744190-c74d-5c3b-9391-86d742611d60 with scrape type 2
2026-03-28 10:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f744190-c74d-5c3b-9391-86d742611d60, identifier: MC13380
2026-03-28 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_8ffff17eb7ace9d701f7dd904845da8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380
2026-03-28 10:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380
2026-03-28 10:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f744190-c74d-5c3b-9391-86d742611d60 with identifier: MC13380 to the API
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:25Z',
 'fuel_type': 'petrol',
 'id': '0f744190-c74d-5c3b-9391-86d742611d60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC13380',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 73,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2020}
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC13380%27 HTTP/1.1" 200 None
2026-03-28 10:36:16 [auto1.de] INFO: Saving data for MC13380: {'auction_closing_time': 1774883125.0, 'created_time': 1774032003.611331, 'last_price_update_time': 1774694176.95047}
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC13380') HTTP/1.1" 204 0
2026-03-28 10:36:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA64256/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-28 10:36:16 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD16668%27 HTTP/1.1" 200 None
2026-03-28 10:36:16 [auto1.de] INFO: Scrape type for TD16668: 2
2026-03-28 10:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668
2026-03-28 10:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d0020c2-0353-533d-adce-6bd1bb043478 with scrape type 2
2026-03-28 10:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d0020c2-0353-533d-adce-6bd1bb043478 with scrape type 2
2026-03-28 10:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d0020c2-0353-533d-adce-6bd1bb043478, identifier: TD16668
2026-03-28 10:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH34221/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668
2026-03-28 10:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668
2026-03-28 10:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d0020c2-0353-533d-adce-6bd1bb043478 with identifier: TD16668 to the API
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:33:24Z',
 'fuel_type': 'petrol',
 'id': '6d0020c2-0353-533d-adce-6bd1bb043478',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD16668',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 161194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-09',
 'seller_name': None,
 'title': 'Audi TT 1.8 Turbo Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2003}
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD16668%27 HTTP/1.1" 200 None
2026-03-28 10:36:17 [auto1.de] INFO: Saving data for TD16668: {'auction_closing_time': 1774884804.0, 'created_time': 1773427413.427599, 'last_price_update_time': 1774694177.415769}
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD16668') HTTP/1.1" 204 0
2026-03-28 10:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54285%27 HTTP/1.1" 200 None
2026-03-28 10:36:17 [auto1.de] INFO: Scrape type for GF54285: 1
2026-03-28 10:36:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabff9850>
2026-03-28 10:36:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_8ffff17eb7ace9d701f7dd904845da8c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_8ffff17eb7ace9d701f7dd904845da8c.jpg saved to cache
2026-03-28 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM74850%27 HTTP/1.1" 200 None
2026-03-28 10:36:17 [auto1.de] INFO: Scrape type for JM74850: 1
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR42013%27 HTTP/1.1" 200 None
2026-03-28 10:36:17 [auto1.de] INFO: Scrape type for CR42013: 1
2026-03-28 10:36:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP25742/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-28 10:36:17 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU69011%27 HTTP/1.1" 200 None
2026-03-28 10:36:17 [auto1.de] INFO: Scrape type for CU69011: 2
2026-03-28 10:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011
2026-03-28 10:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd22ca28-403f-5268-aabe-0e6a40051b9a with scrape type 2
2026-03-28 10:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd22ca28-403f-5268-aabe-0e6a40051b9a with scrape type 2
2026-03-28 10:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd22ca28-403f-5268-aabe-0e6a40051b9a, identifier: CU69011
2026-03-28 10:36:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011
2026-03-28 10:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011
2026-03-28 10:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd22ca28-403f-5268-aabe-0e6a40051b9a with identifier: CU69011 to the API
2026-03-28 10:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:20:19Z',
 'fuel_type': 'petrol',
 'id': 'bd22ca28-403f-5268-aabe-0e6a40051b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU69011',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 75347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2020}
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU69011%27 HTTP/1.1" 200 None
2026-03-28 10:36:18 [auto1.de] INFO: Saving data for CU69011: {'auction_closing_time': 1774884019.0, 'created_time': 1774035193.015698, 'last_price_update_time': 1774694178.237513}
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU69011') HTTP/1.1" 204 0
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-28 10:36:18 [auto1.de] INFO: Scrape type for WD92607: 1
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-28 10:36:18 [auto1.de] INFO: Scrape type for GM28208: 1
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-28 10:36:18 [auto1.de] INFO: Scrape type for XE92374: 1
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ06190%27 HTTP/1.1" 200 None
2026-03-28 10:36:18 [auto1.de] INFO: Scrape type for EZ06190: 1
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE79871%27 HTTP/1.1" 200 None
2026-03-28 10:36:18 [auto1.de] INFO: Scrape type for RE79871: 1
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-28 10:36:18 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-28 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_d30005b92f363b21f619ae1e6a1e0d10.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_8f0ec9ac26f7df204000e820174dc0ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_f7dc0405008c846ec41c6119d089d643.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_00602018f9ad6efadcf0ee2e94332ff5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN71880> (referer: https://www.auto1.com/v1/car-details-view/HN71880/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a349d0>
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_d30005b92f363b21f619ae1e6a1e0d10.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_d30005b92f363b21f619ae1e6a1e0d10.jpg saved to cache
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:36:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX18437/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd50ed0>
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_8f0ec9ac26f7df204000e820174dc0ab.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_8f0ec9ac26f7df204000e820174dc0ab.jpg saved to cache
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a06850>
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_f7dc0405008c846ec41c6119d089d643.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_f7dc0405008c846ec41c6119d089d643.jpg saved to cache
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:36:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd3dd90>
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_00602018f9ad6efadcf0ee2e94332ff5.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_00602018f9ad6efadcf0ee2e94332ff5.jpg saved to cache
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880
2026-03-28 10:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e8c254-7c22-5967-8026-a6e882764890 with scrape type 1
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 46e8c254-7c22-5967-8026-a6e882764890
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_ecb95c07c5568a04997cb365076397e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_ecb95c07c5568a04997cb365076397e7.jpg not downloaded yet
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_78e937ff6873e18f1d7dbdac0284dc0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_78e937ff6873e18f1d7dbdac0284dc0a.jpg not downloaded yet
2026-03-28 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB91995/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_5b37d2d6aba508eb8a207a79e2f06746.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_5b37d2d6aba508eb8a207a79e2f06746.jpg not downloaded yet
2026-03-28 10:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_cb06099993f0a3b83b598b89a5d0bdf8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_cb06099993f0a3b83b598b89a5d0bdf8.jpg not downloaded yet
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_362096e64c23db6b4190a575e2dd4ab6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_362096e64c23db6b4190a575e2dd4ab6.jpg not downloaded yet
2026-03-28 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_ecb95c07c5568a04997cb365076397e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW82863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC64872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a06150>
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_ecb95c07c5568a04997cb365076397e7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_ecb95c07c5568a04997cb365076397e7.jpg saved to cache
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46e8c254-7c22-5967-8026-a6e882764890
2026-03-28 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_78e937ff6873e18f1d7dbdac0284dc0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_cb06099993f0a3b83b598b89a5d0bdf8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_362096e64c23db6b4190a575e2dd4ab6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_5b37d2d6aba508eb8a207a79e2f06746.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad4250>
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_78e937ff6873e18f1d7dbdac0284dc0a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_78e937ff6873e18f1d7dbdac0284dc0a.jpg saved to cache
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46e8c254-7c22-5967-8026-a6e882764890
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc6c10>
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_cb06099993f0a3b83b598b89a5d0bdf8.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_cb06099993f0a3b83b598b89a5d0bdf8.jpg saved to cache
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46e8c254-7c22-5967-8026-a6e882764890
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a0a8d0>
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_362096e64c23db6b4190a575e2dd4ab6.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_362096e64c23db6b4190a575e2dd4ab6.jpg saved to cache
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46e8c254-7c22-5967-8026-a6e882764890
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe52210>
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf9%252F5c%252Ff95c44c039e8891d8cb1b4cfc05ed778%252Fpa%252FHN71880_5b37d2d6aba508eb8a207a79e2f06746.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_5b37d2d6aba508eb8a207a79e2f06746.jpg saved to cache
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46e8c254-7c22-5967-8026-a6e882764890
2026-03-28 10:36:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46e8c254-7c22-5967-8026-a6e882764890, skipping ID generation
2026-03-28 10:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46e8c254-7c22-5967-8026-a6e882764890 with scrape type 1
2026-03-28 10:36:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46e8c254-7c22-5967-8026-a6e882764890 sending to next pipeline
2026-03-28 10:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46e8c254-7c22-5967-8026-a6e882764890, identifier: HN71880
2026-03-28 10:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880
2026-03-28 10:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880
2026-03-28 10:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46e8c254-7c22-5967-8026-a6e882764890 with identifier: HN71880 to the API
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_5b37d2d6aba508eb8a207a79e2f06746.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:04:04Z',
 'fuel_type': 'petrol',
 'id': '46e8c254-7c22-5967-8026-a6e882764890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN71880',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 122855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103514,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_ecb95c07c5568a04997cb365076397e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_78e937ff6873e18f1d7dbdac0284dc0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_5b37d2d6aba508eb8a207a79e2f06746.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_cb06099993f0a3b83b598b89a5d0bdf8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46e8c254-7c22-5967-8026-a6e882764890/46e8c254-7c22-5967-8026-a6e882764890_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf9/5c/f95c44c039e8891d8cb1b4cfc05ed778/pa/HN71880_362096e64c23db6b4190a575e2dd4ab6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': "Renault Megane 1.6 Je t'aime",
 'transmission': 'manual',
 'trim': "Je t'aime",
 'year': 2011}
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN71880%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [auto1.de] INFO: Saving data for HN71880: {'created_time': 1774694180.024189, 'last_price_update_time': 1774694180.024199, 'auction_closing_time': 1774883044.0}
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN71880') HTTP/1.1" 204 0
2026-03-28 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT60125> (referer: https://www.auto1.com/v1/car-details-view/AT60125/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125
2026-03-28 10:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with scrape type 1
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_ae75873940e4220acc1f342f5e474bb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_ae75873940e4220acc1f342f5e474bb7.jpg not downloaded yet
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_78e361924fd57ba196d7e887f0667f0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_78e361924fd57ba196d7e887f0667f0a.jpg not downloaded yet
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_b9bd123be2babd4a4d4bf65212a1dc78.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_b9bd123be2babd4a4d4bf65212a1dc78.jpg not downloaded yet
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_eb922fc5b911bfab1396fd2a270261a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_eb922fc5b911bfab1396fd2a270261a3.jpg not downloaded yet
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_845a868f3fcfb78cb27cbfc27bc4f8b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_845a868f3fcfb78cb27cbfc27bc4f8b2.jpg not downloaded yet
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_d2c278a65a58f09d875ae5b5bdc67ad4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_d2c278a65a58f09d875ae5b5bdc67ad4.jpg not downloaded yet
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_34141190574b2cda87fed331b470a9b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_34141190574b2cda87fed331b470a9b9.jpg not downloaded yet
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_f49ab3abd06ecef108f8583b50e2804a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_f49ab3abd06ecef108f8583b50e2804a.jpg not downloaded yet
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_b6d4d0b1f6ee7704dc7f656f3791f004.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_b6d4d0b1f6ee7704dc7f656f3791f004.jpg not downloaded yet
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_e90c989e1cec6b915564b583981a57d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_e90c989e1cec6b915564b583981a57d8.jpg not downloaded yet
2026-03-28 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY16606/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_e90c989e1cec6b915564b583981a57d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd58f50>
2026-03-28 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_e90c989e1cec6b915564b583981a57d8.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_e90c989e1cec6b915564b583981a57d8.jpg saved to cache
2026-03-28 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE79871/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_b6d4d0b1f6ee7704dc7f656f3791f004.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda4550>
2026-03-28 10:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_b6d4d0b1f6ee7704dc7f656f3791f004.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_b6d4d0b1f6ee7704dc7f656f3791f004.jpg saved to cache
2026-03-28 10:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ06190/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_f49ab3abd06ecef108f8583b50e2804a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc5390>
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_f49ab3abd06ecef108f8583b50e2804a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_f49ab3abd06ecef108f8583b50e2804a.jpg saved to cache
2026-03-28 10:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CR42013/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP03101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_34141190574b2cda87fed331b470a9b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd2d050>
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_34141190574b2cda87fed331b470a9b9.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_34141190574b2cda87fed331b470a9b9.jpg saved to cache
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM28208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_d2c278a65a58f09d875ae5b5bdc67ad4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd2cdd0>
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_d2c278a65a58f09d875ae5b5bdc67ad4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_d2c278a65a58f09d875ae5b5bdc67ad4.jpg saved to cache
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_845a868f3fcfb78cb27cbfc27bc4f8b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BC15764/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe15410>
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_845a868f3fcfb78cb27cbfc27bc4f8b2.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_845a868f3fcfb78cb27cbfc27bc4f8b2.jpg saved to cache
2026-03-28 10:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_eb922fc5b911bfab1396fd2a270261a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f0890>
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_eb922fc5b911bfab1396fd2a270261a3.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_eb922fc5b911bfab1396fd2a270261a3.jpg saved to cache
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD92607/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_b9bd123be2babd4a4d4bf65212a1dc78.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe70dd0>
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_b9bd123be2babd4a4d4bf65212a1dc78.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_b9bd123be2babd4a4d4bf65212a1dc78.jpg saved to cache
2026-03-28 10:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC64872> (referer: https://www.auto1.com/v1/car-details-view/RC64872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872
2026-03-28 10:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa with scrape type 1
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_827619c40cf6866ff7fe8335d981a25a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_827619c40cf6866ff7fe8335d981a25a.jpg not downloaded yet
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_51b44d823cac8946235699dab1e15f16.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_51b44d823cac8946235699dab1e15f16.jpg not downloaded yet
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_9eabe06d43ced517d77dc037acf700b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_9eabe06d43ced517d77dc037acf700b3.jpg not downloaded yet
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_7c0496dc9f30683a5fc00d80f3627c25.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_7c0496dc9f30683a5fc00d80f3627c25.jpg not downloaded yet
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_c66c69b1fb156c208b7c9c64e6a90955.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_c66c69b1fb156c208b7c9c64e6a90955.jpg not downloaded yet
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_e1bd0076d1c726f51618cb51387b96c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_e1bd0076d1c726f51618cb51387b96c1.jpg not downloaded yet
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_ab08c6efad5566011ce41ed69f4bbe92.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_ab08c6efad5566011ce41ed69f4bbe92.jpg not downloaded yet
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_c76305c1b9fde35982001c81e58b6d5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_c76305c1b9fde35982001c81e58b6d5a.jpg not downloaded yet
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_d615654343364d27f7ad3c703fa071d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_d615654343364d27f7ad3c703fa071d9.jpg not downloaded yet
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_3eb7c0732a277f46a8e890bbb066e6f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_3eb7c0732a277f46a8e890bbb066e6f4.jpg not downloaded yet
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB66562/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_78e361924fd57ba196d7e887f0667f0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd33d10>
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_78e361924fd57ba196d7e887f0667f0a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_78e361924fd57ba196d7e887f0667f0a.jpg saved to cache
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_3eb7c0732a277f46a8e890bbb066e6f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_d615654343364d27f7ad3c703fa071d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5e310>
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_3eb7c0732a277f46a8e890bbb066e6f4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_3eb7c0732a277f46a8e890bbb066e6f4.jpg saved to cache
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a06b10>
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_d615654343364d27f7ad3c703fa071d9.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_d615654343364d27f7ad3c703fa071d9.jpg saved to cache
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_c76305c1b9fde35982001c81e58b6d5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdaa390>
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_c76305c1b9fde35982001c81e58b6d5a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_c76305c1b9fde35982001c81e58b6d5a.jpg saved to cache
2026-03-28 10:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_ab08c6efad5566011ce41ed69f4bbe92.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf76f10>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_ab08c6efad5566011ce41ed69f4bbe92.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_ab08c6efad5566011ce41ed69f4bbe92.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_e1bd0076d1c726f51618cb51387b96c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_c66c69b1fb156c208b7c9c64e6a90955.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda8890>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_e1bd0076d1c726f51618cb51387b96c1.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_e1bd0076d1c726f51618cb51387b96c1.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_7c0496dc9f30683a5fc00d80f3627c25.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd2c890>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_c66c69b1fb156c208b7c9c64e6a90955.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_c66c69b1fb156c208b7c9c64e6a90955.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ac84826d0>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_7c0496dc9f30683a5fc00d80f3627c25.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_7c0496dc9f30683a5fc00d80f3627c25.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE79871> (referer: https://www.auto1.com/v1/car-details-view/RE79871/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_9eabe06d43ced517d77dc037acf700b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_827619c40cf6866ff7fe8335d981a25a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871
2026-03-28 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d742c00-bce8-52f3-be15-56c84b379a5f with scrape type 1
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4d742c00-bce8-52f3-be15-56c84b379a5f
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_081ac509276240e1c1220d6de53f6d14.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_081ac509276240e1c1220d6de53f6d14.jpg not downloaded yet
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_8017a63b263850044fb1f01ad4c977d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_8017a63b263850044fb1f01ad4c977d3.jpg not downloaded yet
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_ae75873940e4220acc1f342f5e474bb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_7f53fb170fc50696b194198d08d0fe3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_7f53fb170fc50696b194198d08d0fe3a.jpg not downloaded yet
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f23d0>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_9eabe06d43ced517d77dc037acf700b3.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_9eabe06d43ced517d77dc037acf700b3.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_6574fa3826d918d197c4d71e2af8cde1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_6574fa3826d918d197c4d71e2af8cde1.jpg not downloaded yet
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_51b44d823cac8946235699dab1e15f16.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_ac99750dbac199325afc2695bd7484ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_ac99750dbac199325afc2695bd7484ce.jpg not downloaded yet
2026-03-28 10:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY16606> (referer: https://www.auto1.com/v1/car-details-view/DY16606/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a36690>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_827619c40cf6866ff7fe8335d981a25a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_827619c40cf6866ff7fe8335d981a25a.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_20e0a8ee28947e0ddbb90b9a9fbbb828.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_20e0a8ee28947e0ddbb90b9a9fbbb828.jpg not downloaded yet
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe4efd0>
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F4c%252Fb94c4b0d74c8c527746043178aad14f2%252Fpa%252FAT60125_ae75873940e4220acc1f342f5e474bb7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_ae75873940e4220acc1f342f5e474bb7.jpg saved to cache
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77
2026-03-28 10:36:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7a90115-bf44-5b9d-b03f-a2efb7f94f77, skipping ID generation
2026-03-28 10:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with scrape type 1
2026-03-28 10:36:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7a90115-bf44-5b9d-b03f-a2efb7f94f77 sending to next pipeline
2026-03-28 10:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7a90115-bf44-5b9d-b03f-a2efb7f94f77, identifier: AT60125
2026-03-28 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125
2026-03-28 10:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125
2026-03-28 10:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7a90115-bf44-5b9d-b03f-a2efb7f94f77 with identifier: AT60125 to the API
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_ae75873940e4220acc1f342f5e474bb7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:50:55Z',
 'fuel_type': 'diesel',
 'id': 'd7a90115-bf44-5b9d-b03f-a2efb7f94f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT60125',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 157868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_ae75873940e4220acc1f342f5e474bb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2762812,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_78e361924fd57ba196d7e887f0667f0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2665118,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_b9bd123be2babd4a4d4bf65212a1dc78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2738978,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_eb922fc5b911bfab1396fd2a270261a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_845a868f3fcfb78cb27cbfc27bc4f8b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2777763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_d2c278a65a58f09d875ae5b5bdc67ad4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_34141190574b2cda87fed331b470a9b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_f49ab3abd06ecef108f8583b50e2804a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2813140,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_b6d4d0b1f6ee7704dc7f656f3791f004.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7a90115-bf44-5b9d-b03f-a2efb7f94f77/d7a90115-bf44-5b9d-b03f-a2efb7f94f77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2761647,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/4c/b94c4b0d74c8c527746043178aad14f2/pa/AT60125_e90c989e1cec6b915564b583981a57d8.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT60125%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [auto1.de] INFO: Saving data for AT60125: {'created_time': 1774694188.487276, 'last_price_update_time': 1774694188.487288, 'auction_closing_time': 1774885855.0}
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT60125') HTTP/1.1" 204 0
2026-03-28 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_7f53fb170fc50696b194198d08d0fe3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_8017a63b263850044fb1f01ad4c977d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_6574fa3826d918d197c4d71e2af8cde1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88bf650>
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F4e%252Fa34e960c1a080267b98311220e00261a%252Fpa%252FRC64872_51b44d823cac8946235699dab1e15f16.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_51b44d823cac8946235699dab1e15f16.jpg saved to cache
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa
2026-03-28 10:36:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e64e4cb5-9aec-5664-97ce-719fbb0b1efa, skipping ID generation
2026-03-28 10:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa with scrape type 1
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e64e4cb5-9aec-5664-97ce-719fbb0b1efa sending to next pipeline
2026-03-28 10:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e64e4cb5-9aec-5664-97ce-719fbb0b1efa, identifier: RC64872
2026-03-28 10:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606
2026-03-28 10:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with scrape type 1
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_4ec030309a38db741ce84453e7105b11.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_4ec030309a38db741ce84453e7105b11.jpg not downloaded yet
2026-03-28 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 10:36:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872
2026-03-28 10:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e64e4cb5-9aec-5664-97ce-719fbb0b1efa with identifier: RC64872 to the API
2026-03-28 10:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_51b44d823cac8946235699dab1e15f16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:54:48Z',
 'fuel_type': 'petrol',
 'id': 'e64e4cb5-9aec-5664-97ce-719fbb0b1efa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC64872',
 'listing': 'auction',
 'location': 'DE, Elmshorn',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 78284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_827619c40cf6866ff7fe8335d981a25a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_51b44d823cac8946235699dab1e15f16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_9eabe06d43ced517d77dc037acf700b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_7c0496dc9f30683a5fc00d80f3627c25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_c66c69b1fb156c208b7c9c64e6a90955.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_e1bd0076d1c726f51618cb51387b96c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_ab08c6efad5566011ce41ed69f4bbe92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_c76305c1b9fde35982001c81e58b6d5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_d615654343364d27f7ad3c703fa071d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e64e4cb5-9aec-5664-97ce-719fbb0b1efa/e64e4cb5-9aec-5664-97ce-719fbb0b1efa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/4e/a34e960c1a080267b98311220e00261a/pa/RC64872_3eb7c0732a277f46a8e890bbb066e6f4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-06-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2008}
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64872%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [auto1.de] INFO: Saving data for RC64872: {'created_time': 1774694189.227025, 'last_price_update_time': 1774694189.227036, 'auction_closing_time': 1774886088.0}
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC64872') HTTP/1.1" 204 0
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_48fa43b9f6e9aee76a409ece9bdb4b24.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_48fa43b9f6e9aee76a409ece9bdb4b24.jpg not downloaded yet
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf918d0>
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_7f53fb170fc50696b194198d08d0fe3a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_7f53fb170fc50696b194198d08d0fe3a.jpg saved to cache
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d742c00-bce8-52f3-be15-56c84b379a5f
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd25d90>
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_8017a63b263850044fb1f01ad4c977d3.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_8017a63b263850044fb1f01ad4c977d3.jpg saved to cache
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d742c00-bce8-52f3-be15-56c84b379a5f
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf77990>
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_6574fa3826d918d197c4d71e2af8cde1.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_6574fa3826d918d197c4d71e2af8cde1.jpg saved to cache
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d742c00-bce8-52f3-be15-56c84b379a5f
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_46e0b1db30f9dec6e4e52acb9a152fc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_46e0b1db30f9dec6e4e52acb9a152fc1.jpg not downloaded yet
2026-03-28 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_20e0a8ee28947e0ddbb90b9a9fbbb828.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_081ac509276240e1c1220d6de53f6d14.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_ac99750dbac199325afc2695bd7484ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_6e1492b873bb009069462e0ff352d54c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_6e1492b873bb009069462e0ff352d54c.jpg not downloaded yet
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_2bab60be184cdb6f8e30e6faa8d5e727.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_2bab60be184cdb6f8e30e6faa8d5e727.jpg not downloaded yet
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_c17d725e8b1babadb599bcb7d899bf68.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_c17d725e8b1babadb599bcb7d899bf68.jpg not downloaded yet
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_a0da7d3c71e8574390edefe42709265f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_a0da7d3c71e8574390edefe42709265f.jpg not downloaded yet
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_5b36f8113af03595bee77585d55311ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_5b36f8113af03595bee77585d55311ea.jpg not downloaded yet
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_154c4d818c2013f33afa69b9ae8492b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_154c4d818c2013f33afa69b9ae8492b7.jpg not downloaded yet
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8ead0>
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_20e0a8ee28947e0ddbb90b9a9fbbb828.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_20e0a8ee28947e0ddbb90b9a9fbbb828.jpg saved to cache
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d742c00-bce8-52f3-be15-56c84b379a5f
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a37510>
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_081ac509276240e1c1220d6de53f6d14.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_081ac509276240e1c1220d6de53f6d14.jpg saved to cache
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d742c00-bce8-52f3-be15-56c84b379a5f
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabffa9d0>
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fdd%252F0cddd529a4457643c619f1265def1e81%252Fpa%252FRE79871_ac99750dbac199325afc2695bd7484ce.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_ac99750dbac199325afc2695bd7484ce.jpg saved to cache
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d742c00-bce8-52f3-be15-56c84b379a5f
2026-03-28 10:36:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d742c00-bce8-52f3-be15-56c84b379a5f, skipping ID generation
2026-03-28 10:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d742c00-bce8-52f3-be15-56c84b379a5f with scrape type 1
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d742c00-bce8-52f3-be15-56c84b379a5f sending to next pipeline
2026-03-28 10:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d742c00-bce8-52f3-be15-56c84b379a5f, identifier: RE79871
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_64637e2ef3569e9ec76f71d98c464a47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_64637e2ef3569e9ec76f71d98c464a47.jpg not downloaded yet
2026-03-28 10:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871
2026-03-28 10:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871
2026-03-28 10:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d742c00-bce8-52f3-be15-56c84b379a5f with identifier: RE79871 to the API
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_ac99750dbac199325afc2695bd7484ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:09:55Z',
 'fuel_type': 'petrol',
 'id': '4d742c00-bce8-52f3-be15-56c84b379a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE79871',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 115917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_081ac509276240e1c1220d6de53f6d14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_8017a63b263850044fb1f01ad4c977d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_7f53fb170fc50696b194198d08d0fe3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80988,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_6574fa3826d918d197c4d71e2af8cde1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_ac99750dbac199325afc2695bd7484ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d742c00-bce8-52f3-be15-56c84b379a5f/4d742c00-bce8-52f3-be15-56c84b379a5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/dd/0cddd529a4457643c619f1265def1e81/pa/RE79871_20e0a8ee28947e0ddbb90b9a9fbbb828.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE79871%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [auto1.de] INFO: Saving data for RE79871: {'created_time': 1774694190.366859, 'last_price_update_time': 1774694190.36687, 'auction_closing_time': 1774883395.0}
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE79871') HTTP/1.1" 204 0
2026-03-28 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_46e0b1db30f9dec6e4e52acb9a152fc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP25742> (referer: https://www.auto1.com/v1/car-details-view/HP25742/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_48fa43b9f6e9aee76a409ece9bdb4b24.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_4ec030309a38db741ce84453e7105b11.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88e7150>
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_46e0b1db30f9dec6e4e52acb9a152fc1.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_46e0b1db30f9dec6e4e52acb9a152fc1.jpg saved to cache
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3ef2b1c-6030-5023-a72e-ba932bad151d with identifier: HP25742
2026-03-28 10:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ef2b1c-6030-5023-a72e-ba932bad151d with scrape type 1
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c3ef2b1c-6030-5023-a72e-ba932bad151d
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_c2d2ee46dabc4e01497a06be9ce5d702.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_c2d2ee46dabc4e01497a06be9ce5d702.jpg not downloaded yet
2026-03-28 10:36:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd40810>
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_48fa43b9f6e9aee76a409ece9bdb4b24.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_48fa43b9f6e9aee76a409ece9bdb4b24.jpg saved to cache
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad1110>
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_4ec030309a38db741ce84453e7105b11.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_4ec030309a38db741ce84453e7105b11.jpg saved to cache
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_5b36f8113af03595bee77585d55311ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_53c07c5a00b18606a13d8bcb500f1fe4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_53c07c5a00b18606a13d8bcb500f1fe4.jpg not downloaded yet
2026-03-28 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_154c4d818c2013f33afa69b9ae8492b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_e5b64b95ceb37fa26b68ca811a21cadb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_e5b64b95ceb37fa26b68ca811a21cadb.jpg not downloaded yet
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_12733f0fe31b4225d66c8b4eb0860aaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_12733f0fe31b4225d66c8b4eb0860aaf.jpg not downloaded yet
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_1fec9606f567d758e448e49af4784bce.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_1fec9606f567d758e448e49af4784bce.jpg not downloaded yet
2026-03-28 10:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_53c07c5a00b18606a13d8bcb500f1fe4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd7a2d0>
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_5b36f8113af03595bee77585d55311ea.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_5b36f8113af03595bee77585d55311ea.jpg saved to cache
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_c2d2ee46dabc4e01497a06be9ce5d702.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ace90>
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_154c4d818c2013f33afa69b9ae8492b7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_154c4d818c2013f33afa69b9ae8492b7.jpg saved to cache
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_1fec9606f567d758e448e49af4784bce.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe81a90>
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_53c07c5a00b18606a13d8bcb500f1fe4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_53c07c5a00b18606a13d8bcb500f1fe4.jpg saved to cache
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3ef2b1c-6030-5023-a72e-ba932bad151d
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88f9290>
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_c2d2ee46dabc4e01497a06be9ce5d702.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_c2d2ee46dabc4e01497a06be9ce5d702.jpg saved to cache
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3ef2b1c-6030-5023-a72e-ba932bad151d
2026-03-28 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_12733f0fe31b4225d66c8b4eb0860aaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_e5b64b95ceb37fa26b68ca811a21cadb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd7a790>
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_1fec9606f567d758e448e49af4784bce.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_1fec9606f567d758e448e49af4784bce.jpg saved to cache
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3ef2b1c-6030-5023-a72e-ba932bad151d
2026-03-28 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_64637e2ef3569e9ec76f71d98c464a47.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_a0da7d3c71e8574390edefe42709265f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf4efd0>
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_12733f0fe31b4225d66c8b4eb0860aaf.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_12733f0fe31b4225d66c8b4eb0860aaf.jpg saved to cache
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3ef2b1c-6030-5023-a72e-ba932bad151d
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd7aed0>
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252Fc3%252F11c37ed74d950547e9c474d55a4000da%252Fpa%252FHP25742_e5b64b95ceb37fa26b68ca811a21cadb.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_e5b64b95ceb37fa26b68ca811a21cadb.jpg saved to cache
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3ef2b1c-6030-5023-a72e-ba932bad151d
2026-03-28 10:36:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3ef2b1c-6030-5023-a72e-ba932bad151d, skipping ID generation
2026-03-28 10:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3ef2b1c-6030-5023-a72e-ba932bad151d with scrape type 1
2026-03-28 10:36:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3ef2b1c-6030-5023-a72e-ba932bad151d sending to next pipeline
2026-03-28 10:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3ef2b1c-6030-5023-a72e-ba932bad151d, identifier: HP25742
2026-03-28 10:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3ef2b1c-6030-5023-a72e-ba932bad151d with identifier: HP25742
2026-03-28 10:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3ef2b1c-6030-5023-a72e-ba932bad151d with identifier: HP25742
2026-03-28 10:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3ef2b1c-6030-5023-a72e-ba932bad151d with identifier: HP25742 to the API
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_e5b64b95ceb37fa26b68ca811a21cadb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:21:44Z',
 'fuel_type': 'petrol',
 'id': 'c3ef2b1c-6030-5023-a72e-ba932bad151d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP25742',
 'listing': 'auction',
 'location': 'DE, Worms',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 63321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_c2d2ee46dabc4e01497a06be9ce5d702.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_53c07c5a00b18606a13d8bcb500f1fe4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_e5b64b95ceb37fa26b68ca811a21cadb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_12733f0fe31b4225d66c8b4eb0860aaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3ef2b1c-6030-5023-a72e-ba932bad151d/c3ef2b1c-6030-5023-a72e-ba932bad151d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/c3/11c37ed74d950547e9c474d55a4000da/pa/HP25742_1fec9606f567d758e448e49af4784bce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2008}
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP25742%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [auto1.de] INFO: Saving data for HP25742: {'created_time': 1774694192.134197, 'last_price_update_time': 1774694192.134208, 'auction_closing_time': 1774884104.0}
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP25742') HTTP/1.1" 204 0
2026-03-28 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_2bab60be184cdb6f8e30e6faa8d5e727.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX18437> (referer: https://www.auto1.com/v1/car-details-view/SX18437/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd3ec90>
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_64637e2ef3569e9ec76f71d98c464a47.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_64637e2ef3569e9ec76f71d98c464a47.jpg saved to cache
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfbd990>
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_a0da7d3c71e8574390edefe42709265f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_a0da7d3c71e8574390edefe42709265f.jpg saved to cache
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd40190>
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_2bab60be184cdb6f8e30e6faa8d5e727.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_2bab60be184cdb6f8e30e6faa8d5e727.jpg saved to cache
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437
2026-03-28 10:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc with scrape type 1
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_ce9a18e9ff4b5c97cddc4edb2279a4d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_ce9a18e9ff4b5c97cddc4edb2279a4d7.jpg not downloaded yet
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_e6900811706e71ebd9427a12c0372f12.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_e6900811706e71ebd9427a12c0372f12.jpg not downloaded yet
2026-03-28 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_c17d725e8b1babadb599bcb7d899bf68.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_51d16a30194aee30f94d38f1a63b46fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_51d16a30194aee30f94d38f1a63b46fb.jpg not downloaded yet
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_8d18212cc38e570aedbf5b84e9b0a942.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_8d18212cc38e570aedbf5b84e9b0a942.jpg not downloaded yet
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_cd81c05d00bfb5732d89fe03d389bff4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_cd81c05d00bfb5732d89fe03d389bff4.jpg not downloaded yet
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_d8601a93b9f8bf4330e0f77660d0ae47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_d8601a93b9f8bf4330e0f77660d0ae47.jpg not downloaded yet
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_494b9ed908e02ade0de915e06da6a144.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_494b9ed908e02ade0de915e06da6a144.jpg not downloaded yet
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_c807e2dccf75437e163b34b51b09d5a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_c807e2dccf75437e163b34b51b09d5a4.jpg not downloaded yet
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_618253d2adec47f37bfd3fdef2574e23.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_618253d2adec47f37bfd3fdef2574e23.jpg not downloaded yet
2026-03-28 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe13d10>
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_c17d725e8b1babadb599bcb7d899bf68.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_c17d725e8b1babadb599bcb7d899bf68.jpg saved to cache
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_42480bc1e316941946adcc48b44ba050.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_42480bc1e316941946adcc48b44ba050.jpg not downloaded yet
2026-03-28 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_e6900811706e71ebd9427a12c0372f12.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_6e1492b873bb009069462e0ff352d54c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_618253d2adec47f37bfd3fdef2574e23.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ad790>
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_e6900811706e71ebd9427a12c0372f12.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_e6900811706e71ebd9427a12c0372f12.jpg saved to cache
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd55f50>
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Ff7%252F2df7e59ccb8b0784bcc9ef799c886ad0%252Fpa%252FDY16606_6e1492b873bb009069462e0ff352d54c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_6e1492b873bb009069462e0ff352d54c.jpg saved to cache
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1
2026-03-28 10:36:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1, skipping ID generation
2026-03-28 10:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with scrape type 1
2026-03-28 10:36:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 sending to next pipeline
2026-03-28 10:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1, identifier: DY16606
2026-03-28 10:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606
2026-03-28 10:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606
2026-03-28 10:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e6bc9f2-b57f-5116-95a6-37e82f613bf1 with identifier: DY16606 to the API
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_6e1492b873bb009069462e0ff352d54c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:23:50Z',
 'fuel_type': 'petrol',
 'id': '5e6bc9f2-b57f-5116-95a6-37e82f613bf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY16606',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 61153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963728,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_4ec030309a38db741ce84453e7105b11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2755510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_48fa43b9f6e9aee76a409ece9bdb4b24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_46e0b1db30f9dec6e4e52acb9a152fc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2708594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_6e1492b873bb009069462e0ff352d54c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_2bab60be184cdb6f8e30e6faa8d5e727.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_c17d725e8b1babadb599bcb7d899bf68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2902608,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_a0da7d3c71e8574390edefe42709265f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_5b36f8113af03595bee77585d55311ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_154c4d818c2013f33afa69b9ae8492b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e6bc9f2-b57f-5116-95a6-37e82f613bf1/5e6bc9f2-b57f-5116-95a6-37e82f613bf1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992590,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/f7/2df7e59ccb8b0784bcc9ef799c886ad0/pa/DY16606_64637e2ef3569e9ec76f71d98c464a47.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY16606%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [auto1.de] INFO: Saving data for DY16606: {'created_time': 1774694193.535791, 'last_price_update_time': 1774694193.535806, 'auction_closing_time': 1774884230.0}
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY16606') HTTP/1.1" 204 0
2026-03-28 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_42480bc1e316941946adcc48b44ba050.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ06190> (referer: https://www.auto1.com/v1/car-details-view/EZ06190/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM28208> (referer: https://www.auto1.com/v1/car-details-view/GM28208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe4cdd0>
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_618253d2adec47f37bfd3fdef2574e23.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_618253d2adec47f37bfd3fdef2574e23.jpg saved to cache
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_c807e2dccf75437e163b34b51b09d5a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb6ed0>
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_42480bc1e316941946adcc48b44ba050.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_42480bc1e316941946adcc48b44ba050.jpg saved to cache
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190
2026-03-28 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with scrape type 1
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_b87116ef5e17b269e090cbf7e18a22aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_b87116ef5e17b269e090cbf7e18a22aa.jpg not downloaded yet
2026-03-28 10:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208
2026-03-28 10:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18d3337-9dac-5715-b7de-07abedf435ab with scrape type 1
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b18d3337-9dac-5715-b7de-07abedf435ab
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_f13d1f549d30ee153c6b971e6b822c08.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_f13d1f549d30ee153c6b971e6b822c08.jpg not downloaded yet
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_014ad01810c4afb5c22fbfa8e8810a02.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_014ad01810c4afb5c22fbfa8e8810a02.jpg not downloaded yet
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_4668e06f9bbc0c5b2bf66f5700f4940e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_4668e06f9bbc0c5b2bf66f5700f4940e.jpg not downloaded yet
2026-03-28 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_494b9ed908e02ade0de915e06da6a144.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_cd81c05d00bfb5732d89fe03d389bff4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_c7b8b8669e067fc771d207917a533f4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_c7b8b8669e067fc771d207917a533f4b.jpg not downloaded yet
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_c9007d8d4d3fdeb75908d0c8d6b0384e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_c9007d8d4d3fdeb75908d0c8d6b0384e.jpg not downloaded yet
2026-03-28 10:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_8d18212cc38e570aedbf5b84e9b0a942.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd84ad0>
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_c807e2dccf75437e163b34b51b09d5a4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_c807e2dccf75437e163b34b51b09d5a4.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_d8601a93b9f8bf4330e0f77660d0ae47.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_d68122035452be0ba9796004f287b52d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_d68122035452be0ba9796004f287b52d.jpg not downloaded yet
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_f3168076b610e3101722088ec9f9f174.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_f3168076b610e3101722088ec9f9f174.jpg not downloaded yet
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_b52159e20246eb7951fe9060ba32686d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_b52159e20246eb7951fe9060ba32686d.jpg not downloaded yet
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_4d734dba71022e5dd85810d73a467fd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_4d734dba71022e5dd85810d73a467fd6.jpg not downloaded yet
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd6d9d0>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_494b9ed908e02ade0de915e06da6a144.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_494b9ed908e02ade0de915e06da6a144.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed7e90>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_cd81c05d00bfb5732d89fe03d389bff4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_cd81c05d00bfb5732d89fe03d389bff4.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe8f390>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_8d18212cc38e570aedbf5b84e9b0a942.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_8d18212cc38e570aedbf5b84e9b0a942.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_f13d1f549d30ee153c6b971e6b822c08.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_4668e06f9bbc0c5b2bf66f5700f4940e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_014ad01810c4afb5c22fbfa8e8810a02.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_c9007d8d4d3fdeb75908d0c8d6b0384e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a077d0>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_d8601a93b9f8bf4330e0f77660d0ae47.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_d8601a93b9f8bf4330e0f77660d0ae47.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe50890>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_f13d1f549d30ee153c6b971e6b822c08.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_f13d1f549d30ee153c6b971e6b822c08.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b18d3337-9dac-5715-b7de-07abedf435ab
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fa390>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_4668e06f9bbc0c5b2bf66f5700f4940e.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_4668e06f9bbc0c5b2bf66f5700f4940e.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b18d3337-9dac-5715-b7de-07abedf435ab
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_d68122035452be0ba9796004f287b52d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_b52159e20246eb7951fe9060ba32686d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_f3168076b610e3101722088ec9f9f174.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf75650>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_014ad01810c4afb5c22fbfa8e8810a02.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_014ad01810c4afb5c22fbfa8e8810a02.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd33a90>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_c9007d8d4d3fdeb75908d0c8d6b0384e.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_c9007d8d4d3fdeb75908d0c8d6b0384e.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b18d3337-9dac-5715-b7de-07abedf435ab
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfe3010>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_d68122035452be0ba9796004f287b52d.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_d68122035452be0ba9796004f287b52d.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd1d350>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_b52159e20246eb7951fe9060ba32686d.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_b52159e20246eb7951fe9060ba32686d.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a08410>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_f3168076b610e3101722088ec9f9f174.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_f3168076b610e3101722088ec9f9f174.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b18d3337-9dac-5715-b7de-07abedf435ab
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_4d734dba71022e5dd85810d73a467fd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_b87116ef5e17b269e090cbf7e18a22aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_c7b8b8669e067fc771d207917a533f4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_51d16a30194aee30f94d38f1a63b46fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB91995> (referer: https://www.auto1.com/v1/car-details-view/PB91995/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CR42013> (referer: https://www.auto1.com/v1/car-details-view/CR42013/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YW82863> (referer: https://www.auto1.com/v1/car-details-view/YW82863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_8b502cf21e229f570a8bf9fe2f8c13c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BC15764> (referer: https://www.auto1.com/v1/car-details-view/BC15764/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd1c390>
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Ffe%252Fdefecc3eefa0a87e94a971c22a7a2fd8%252Fpa%252FGM28208_4d734dba71022e5dd85810d73a467fd6.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_4d734dba71022e5dd85810d73a467fd6.jpg saved to cache
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b18d3337-9dac-5715-b7de-07abedf435ab
2026-03-28 10:36:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b18d3337-9dac-5715-b7de-07abedf435ab, skipping ID generation
2026-03-28 10:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b18d3337-9dac-5715-b7de-07abedf435ab with scrape type 1
2026-03-28 10:36:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b18d3337-9dac-5715-b7de-07abedf435ab sending to next pipeline
2026-03-28 10:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b18d3337-9dac-5715-b7de-07abedf435ab, identifier: GM28208
2026-03-28 10:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 10:36:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208
2026-03-28 10:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b18d3337-9dac-5715-b7de-07abedf435ab with identifier: GM28208 to the API
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_4d734dba71022e5dd85810d73a467fd6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:24:39Z',
 'fuel_type': 'petrol',
 'id': 'b18d3337-9dac-5715-b7de-07abedf435ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM28208',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 244754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_f13d1f549d30ee153c6b971e6b822c08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_4668e06f9bbc0c5b2bf66f5700f4940e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_c9007d8d4d3fdeb75908d0c8d6b0384e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_f3168076b610e3101722088ec9f9f174.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b18d3337-9dac-5715-b7de-07abedf435ab/b18d3337-9dac-5715-b7de-07abedf435ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/fe/defecc3eefa0a87e94a971c22a7a2fd8/pa/GM28208_4d734dba71022e5dd85810d73a467fd6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Kia Soul 1.6 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2009}
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-28 10:36:35 [auto1.de] INFO: Saving data for GM28208: {'created_time': 1774694195.641473, 'last_price_update_time': 1774694195.641483, 'auction_closing_time': 1774884279.0}
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM28208') HTTP/1.1" 204 0
2026-03-28 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_5e1d923a6de70eda29c1b0a5db5d242d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_37e4b8352722cc6fea4af53452e3a9fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_c4403434538e7c0a37d0370bae4f6bfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8e590>
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_b87116ef5e17b269e090cbf7e18a22aa.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_b87116ef5e17b269e090cbf7e18a22aa.jpg saved to cache
2026-03-28 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba79cc10>
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3daa89aba370464f03ec75cc12d93a9%252Fpa%252FEZ06190_c7b8b8669e067fc771d207917a533f4b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_c7b8b8669e067fc771d207917a533f4b.jpg saved to cache
2026-03-28 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2
2026-03-28 10:36:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2, skipping ID generation
2026-03-28 10:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with scrape type 1
2026-03-28 10:36:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 sending to next pipeline
2026-03-28 10:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2, identifier: EZ06190
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba79afd0>
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_51d16a30194aee30f94d38f1a63b46fb.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_51d16a30194aee30f94d38f1a63b46fb.jpg saved to cache
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9029eb12-3026-5bac-a54f-3de792aed609 with identifier: PB91995
2026-03-28 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9029eb12-3026-5bac-a54f-3de792aed609 with scrape type 1
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_e44e8558e57604d93936ee3ae16fdf7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_e44e8558e57604d93936ee3ae16fdf7a.jpg not downloaded yet
2026-03-28 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013
2026-03-28 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 803d7cd5-1181-5f39-a4cb-4550646e3bdb with scrape type 1
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 803d7cd5-1181-5f39-a4cb-4550646e3bdb
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_55f954ace0004bcc23df931eb68ff9e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_55f954ace0004bcc23df931eb68ff9e1.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_7b803d0305dd196bd04f8bfb76b04df8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_7b803d0305dd196bd04f8bfb76b04df8.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_0dc2ef07160bd7a7bb4d7dce79f5539d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_0dc2ef07160bd7a7bb4d7dce79f5539d.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_b936395d1ad65cc09b83cf1eda6258e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_b936395d1ad65cc09b83cf1eda6258e7.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_1e644d3649d33baba55de3cd197afa49.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_1e644d3649d33baba55de3cd197afa49.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_5bde41640a17d442f8848363df33ec5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_5bde41640a17d442f8848363df33ec5d.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_293857f2d925683e93908d751978628a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_293857f2d925683e93908d751978628a.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_b929eec07c458df5bfa19220754feacc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_b929eec07c458df5bfa19220754feacc.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_e5ac5d6822e1812cb39059d014911029.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_e5ac5d6822e1812cb39059d014911029.jpg already downloaded
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F45%252F7345746f5a8071b85f0ab64b3d718d99%252Fpa%252FCR42013_05f5f91802973ce6385f0dfe16069e35.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_05f5f91802973ce6385f0dfe16069e35.jpg already downloaded
2026-03-28 10:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 803d7cd5-1181-5f39-a4cb-4550646e3bdb, identifier: CR42013
2026-03-28 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863
2026-03-28 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773025ac-9114-5ff3-bce6-ad06fcf1366b with scrape type 1
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_367b5f18f2a06dcdc2013dfdd4872f41.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_367b5f18f2a06dcdc2013dfdd4872f41.jpg not downloaded yet
2026-03-28 10:36:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a0d050>
2026-03-28 10:36:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_8b502cf21e229f570a8bf9fe2f8c13c8.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_8b502cf21e229f570a8bf9fe2f8c13c8.jpg saved to cache
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764
2026-03-28 10:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with scrape type 1
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_cc1a8124b2e686961a44543db8ac4742.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_cc1a8124b2e686961a44543db8ac4742.jpg not downloaded yet
2026-03-28 10:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190
2026-03-28 10:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190
2026-03-28 10:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15c44ef8-64b7-58f1-aa0f-aa69c71c22d2 with identifier: EZ06190 to the API
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_c7b8b8669e067fc771d207917a533f4b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 3',
 'engine': '2.1L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:56Z',
 'fuel_type': 'diesel',
 'id': '15c44ef8-64b7-58f1-aa0f-aa69c71c22d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ06190',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 171828,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_b87116ef5e17b269e090cbf7e18a22aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_014ad01810c4afb5c22fbfa8e8810a02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_c7b8b8669e067fc771d207917a533f4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_d68122035452be0ba9796004f287b52d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15c44ef8-64b7-58f1-aa0f-aa69c71c22d2/15c44ef8-64b7-58f1-aa0f-aa69c71c22d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3daa89aba370464f03ec75cc12d93a9/pa/EZ06190_b52159e20246eb7951fe9060ba32686d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-04-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2003}
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ06190%27 HTTP/1.1" 200 None
2026-03-28 10:36:36 [auto1.de] INFO: Saving data for EZ06190: {'created_time': 1774694196.872689, 'last_price_update_time': 1774694196.872698, 'auction_closing_time': 1774884476.0}
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ06190') HTTP/1.1" 204 0
2026-03-28 10:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013
2026-03-28 10:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013
2026-03-28 10:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 803d7cd5-1181-5f39-a4cb-4550646e3bdb with identifier: CR42013 to the API
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CR42013>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:51Z',
 'fuel_type': 'petrol',
 'id': '803d7cd5-1181-5f39-a4cb-4550646e3bdb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR42013',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 138881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_55f954ace0004bcc23df931eb68ff9e1.jpg',
                'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_7b803d0305dd196bd04f8bfb76b04df8.jpg',
                'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_0dc2ef07160bd7a7bb4d7dce79f5539d.jpg',
                'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_b936395d1ad65cc09b83cf1eda6258e7.jpg',
                'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_1e644d3649d33baba55de3cd197afa49.jpg',
                'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_5bde41640a17d442f8848363df33ec5d.jpg',
                'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_293857f2d925683e93908d751978628a.jpg',
                'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_b929eec07c458df5bfa19220754feacc.jpg',
                'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_e5ac5d6822e1812cb39059d014911029.jpg',
                'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_05f5f91802973ce6385f0dfe16069e35.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750368,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_55f954ace0004bcc23df931eb68ff9e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_7b803d0305dd196bd04f8bfb76b04df8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_0dc2ef07160bd7a7bb4d7dce79f5539d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594433,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_b936395d1ad65cc09b83cf1eda6258e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_1e644d3649d33baba55de3cd197afa49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_5bde41640a17d442f8848363df33ec5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_293857f2d925683e93908d751978628a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2607091,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_b929eec07c458df5bfa19220754feacc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2756826,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_e5ac5d6822e1812cb39059d014911029.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_803d7cd5-1181-5f39-a4cb-4550646e3bdb/803d7cd5-1181-5f39-a4cb-4550646e3bdb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img73/45/7345746f5a8071b85f0ab64b3d718d99/pa/CR42013_05f5f91802973ce6385f0dfe16069e35.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI ACT Ambition ultra',
 'transmission': 'manual',
 'trim': 'Ambition ultra',
 'year': 2015}
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR42013%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [auto1.de] INFO: Saving data for CR42013: {'created_time': 1774694197.253983, 'last_price_update_time': 1774694197.253994, 'auction_closing_time': 1774884291.0}
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR42013') HTTP/1.1" 204 0
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_ce9a18e9ff4b5c97cddc4edb2279a4d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_fca113d9bee88ea8f3ad3cd6eeca64f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_5340b4ecacf2303245f52fc958d6a0a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_5340b4ecacf2303245f52fc958d6a0a5.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_a419aeaa8d87f5c13d6fe447c2b38a93.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_a419aeaa8d87f5c13d6fe447c2b38a93.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_e7713d706f884e8a76abd7c4af29fcbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_e7713d706f884e8a76abd7c4af29fcbf.jpg not downloaded yet
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed2a50>
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_5e1d923a6de70eda29c1b0a5db5d242d.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_5e1d923a6de70eda29c1b0a5db5d242d.jpg saved to cache
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfca250>
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_37e4b8352722cc6fea4af53452e3a9fd.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_37e4b8352722cc6fea4af53452e3a9fd.jpg saved to cache
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:36:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a06ed0>
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_c4403434538e7c0a37d0370bae4f6bfb.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_c4403434538e7c0a37d0370bae4f6bfb.jpg saved to cache
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_ed0c191f1a1a8c073d15ffe7d8637d4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_ed0c191f1a1a8c073d15ffe7d8637d4b.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_3a0155e9624a611dd30d5f6a7e3b1ef5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_3a0155e9624a611dd30d5f6a7e3b1ef5.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_897b55eb0f031d7463edd5f9a1e30f47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_897b55eb0f031d7463edd5f9a1e30f47.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_35c9736dfd6370f28f32b572ed2b6248.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_35c9736dfd6370f28f32b572ed2b6248.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_6406bd3615f6aa290c75d634f71194c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_6406bd3615f6aa290c75d634f71194c5.jpg not downloaded yet
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_e0963b0839698e6749f3bfa53eeb4aa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_e0963b0839698e6749f3bfa53eeb4aa6.jpg not downloaded yet
2026-03-28 10:36:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfb8f50>
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F18%252F4118ee9a3e6936f2f1a0b1926728e9d8%252Fpa%252FSX18437_ce9a18e9ff4b5c97cddc4edb2279a4d7.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_ce9a18e9ff4b5c97cddc4edb2279a4d7.jpg saved to cache
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc
2026-03-28 10:36:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08505e1b-1ad2-576d-a433-f2885f6dfcfc, skipping ID generation
2026-03-28 10:36:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc with scrape type 1
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08505e1b-1ad2-576d-a433-f2885f6dfcfc sending to next pipeline
2026-03-28 10:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08505e1b-1ad2-576d-a433-f2885f6dfcfc, identifier: SX18437
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a050d0>
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_fca113d9bee88ea8f3ad3cd6eeca64f9.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_fca113d9bee88ea8f3ad3cd6eeca64f9.jpg saved to cache
2026-03-28 10:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437
2026-03-28 10:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437
2026-03-28 10:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08505e1b-1ad2-576d-a433-f2885f6dfcfc with identifier: SX18437 to the API
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_ce9a18e9ff4b5c97cddc4edb2279a4d7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:01:49Z',
 'fuel_type': 'petrol',
 'id': '08505e1b-1ad2-576d-a433-f2885f6dfcfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX18437',
 'listing': 'auction',
 'location': 'DE, Mülheim\xad-Kärlich',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 29420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 353265,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_ce9a18e9ff4b5c97cddc4edb2279a4d7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75509,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_e6900811706e71ebd9427a12c0372f12.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75152,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_51d16a30194aee30f94d38f1a63b46fb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 329110,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_8d18212cc38e570aedbf5b84e9b0a942.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57092,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_cd81c05d00bfb5732d89fe03d389bff4.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372365,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_d8601a93b9f8bf4330e0f77660d0ae47.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62888,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_494b9ed908e02ade0de915e06da6a144.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3263360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_c807e2dccf75437e163b34b51b09d5a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 285730,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_618253d2adec47f37bfd3fdef2574e23.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08505e1b-1ad2-576d-a433-f2885f6dfcfc/08505e1b-1ad2-576d-a433-f2885f6dfcfc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/18/4118ee9a3e6936f2f1a0b1926728e9d8/pa/SX18437_42480bc1e316941946adcc48b44ba050.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi TOP Collection',
 'transmission': 'manual',
 'trim': 'TOP Collection',
 'year': 2020}
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18437%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [auto1.de] INFO: Saving data for SX18437: {'created_time': 1774694198.402438, 'last_price_update_time': 1774694198.40245, 'auction_closing_time': 1774882909.0}
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX18437') HTTP/1.1" 204 0
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_cb898a92db25c0e6a5152f52cb4bc8af.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_cb898a92db25c0e6a5152f52cb4bc8af.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_313183672c7992d352f9aa434657df18.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_313183672c7992d352f9aa434657df18.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_de6cbd7ac3d9a94ba165d21118fe1fa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_de6cbd7ac3d9a94ba165d21118fe1fa6.jpg not downloaded yet
2026-03-28 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_367b5f18f2a06dcdc2013dfdd4872f41.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_cc1a8124b2e686961a44543db8ac4742.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_cbdc84082b0fd6ef520324cb75dc14d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_cbdc84082b0fd6ef520324cb75dc14d5.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_4b1dc674b48cb966981555a73e5f8105.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_4b1dc674b48cb966981555a73e5f8105.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_5410d705f1adc7890bb0a854575c43bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_5410d705f1adc7890bb0a854575c43bb.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_36abf326d994f78a8a8c3d75d093cacf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_36abf326d994f78a8a8c3d75d093cacf.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_a8fe53d005a05b40a78e0d0f56d421ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_a8fe53d005a05b40a78e0d0f56d421ea.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_bb9939fa3008802e844162d379c8b64a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_bb9939fa3008802e844162d379c8b64a.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_def783695e82bf282c6e9a286258bf9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_def783695e82bf282c6e9a286258bf9c.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_c2500addb5ca6f974913eb1e21ed9cd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_c2500addb5ca6f974913eb1e21ed9cd3.jpg not downloaded yet
2026-03-28 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_e0963b0839698e6749f3bfa53eeb4aa6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_e96e5ec79488c1209621c6aec7f14a75.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_e96e5ec79488c1209621c6aec7f14a75.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_0c85694409fd640b11c5d57bb1ae366c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_0c85694409fd640b11c5d57bb1ae366c.jpg not downloaded yet
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a72590>
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_367b5f18f2a06dcdc2013dfdd4872f41.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_367b5f18f2a06dcdc2013dfdd4872f41.jpg saved to cache
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5c150>
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_cc1a8124b2e686961a44543db8ac4742.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_cc1a8124b2e686961a44543db8ac4742.jpg saved to cache
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1
2026-03-28 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA64256> (referer: https://www.auto1.com/v1/car-details-view/HA64256/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabefd190>
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_e0963b0839698e6749f3bfa53eeb4aa6.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_e0963b0839698e6749f3bfa53eeb4aa6.jpg saved to cache
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1
2026-03-28 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_d53f394094d9b743a6e290bfd8d81a49.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_9f826a3b61c856f0dce20174f84480f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_6406bd3615f6aa290c75d634f71194c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256
2026-03-28 10:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b with scrape type 1
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_aab8b02296fd3399acbdab6829876456.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_aab8b02296fd3399acbdab6829876456.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_bd4bc5f941c73f3229d0f8d2a214f963.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_bd4bc5f941c73f3229d0f8d2a214f963.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_a90fb2dda13e518ff1c634d02d922510.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_a90fb2dda13e518ff1c634d02d922510.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_30c1102954d902e06e726c037666cabe.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_30c1102954d902e06e726c037666cabe.jpg not downloaded yet
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_c60c5f9846ba1b6b7a73adc677f4224b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_c60c5f9846ba1b6b7a73adc677f4224b.jpg not downloaded yet
2026-03-28 10:36:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef4a50>
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_d53f394094d9b743a6e290bfd8d81a49.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_d53f394094d9b743a6e290bfd8d81a49.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab96a9210>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_9f826a3b61c856f0dce20174f84480f8.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_9f826a3b61c856f0dce20174f84480f8.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed0110>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_6406bd3615f6aa290c75d634f71194c5.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_6406bd3615f6aa290c75d634f71194c5.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_0c85694409fd640b11c5d57bb1ae366c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_c954efd7bf6769571087f7616675988a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_c954efd7bf6769571087f7616675988a.jpg not downloaded yet
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_c2500addb5ca6f974913eb1e21ed9cd3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_e96e5ec79488c1209621c6aec7f14a75.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_5eab8fca7130a4d5d15b79c769d97c1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_5eab8fca7130a4d5d15b79c769d97c1f.jpg not downloaded yet
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_46ea26cb5fd2bf4d0b741a16083d5f53.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_46ea26cb5fd2bf4d0b741a16083d5f53.jpg not downloaded yet
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD92607> (referer: https://www.auto1.com/v1/car-details-view/WD92607/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_13f165418fbcecf31e9729a90f3f79dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_13f165418fbcecf31e9729a90f3f79dc.jpg not downloaded yet
2026-03-28 10:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_5734fed730faff4071ad864b8c8047f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_5734fed730faff4071ad864b8c8047f3.jpg not downloaded yet
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5ea50>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_0c85694409fd640b11c5d57bb1ae366c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_0c85694409fd640b11c5d57bb1ae366c.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf8c550>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_c2500addb5ca6f974913eb1e21ed9cd3.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_c2500addb5ca6f974913eb1e21ed9cd3.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc89d0>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_e96e5ec79488c1209621c6aec7f14a75.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_e96e5ec79488c1209621c6aec7f14a75.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_bd4bc5f941c73f3229d0f8d2a214f963.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607
2026-03-28 10:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54737d39-fdf4-5dfd-86f5-23815799b0a9 with scrape type 1
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 54737d39-fdf4-5dfd-86f5-23815799b0a9
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_60a4127a0f5d8cb3859d1572017a9290.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_60a4127a0f5d8cb3859d1572017a9290.jpg not downloaded yet
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_46ea26cb5fd2bf4d0b741a16083d5f53.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_0f34d800e63e4bbdb9df99bb8a1e6f54.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_0f34d800e63e4bbdb9df99bb8a1e6f54.jpg not downloaded yet
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_d50da5cb9490cbf83db8cd22eb7a1704.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_d50da5cb9490cbf83db8cd22eb7a1704.jpg not downloaded yet
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_2796a28f1838a72dcdfd81acab8fadae.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_2796a28f1838a72dcdfd81acab8fadae.jpg not downloaded yet
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_df33656fb2e806194933edf1ef2a44d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_df33656fb2e806194933edf1ef2a44d6.jpg not downloaded yet
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89354d0>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_bd4bc5f941c73f3229d0f8d2a214f963.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_bd4bc5f941c73f3229d0f8d2a214f963.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_a84c3cb633cf18b12abfbbb671d4a7b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_a84c3cb633cf18b12abfbbb671d4a7b4.jpg not downloaded yet
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_60a4127a0f5d8cb3859d1572017a9290.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_5734fed730faff4071ad864b8c8047f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5fe10>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_46ea26cb5fd2bf4d0b741a16083d5f53.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_46ea26cb5fd2bf4d0b741a16083d5f53.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD10006> (referer: https://www.auto1.com/v1/car-details-view/ZD10006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_a90fb2dda13e518ff1c634d02d922510.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_30c1102954d902e06e726c037666cabe.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_c954efd7bf6769571087f7616675988a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_c60c5f9846ba1b6b7a73adc677f4224b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf64f50>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_60a4127a0f5d8cb3859d1572017a9290.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_60a4127a0f5d8cb3859d1572017a9290.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54737d39-fdf4-5dfd-86f5-23815799b0a9
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ac8482650>
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_5734fed730faff4071ad864b8c8047f3.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_5734fed730faff4071ad864b8c8047f3.jpg saved to cache
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006
2026-03-28 10:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with scrape type 1
2026-03-28 10:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 179f74e2-e4af-5acb-99fb-b8a56a7d87c8
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_2c9f0f0b12de5007fb051cc04915532a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_2c9f0f0b12de5007fb051cc04915532a.jpg already downloaded
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_012a7c045aafa8479d3298a3d4c67eed.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_012a7c045aafa8479d3298a3d4c67eed.jpg already downloaded
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_e8eab900e010829f4f96a2be9044b33a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_e8eab900e010829f4f96a2be9044b33a.jpg already downloaded
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_4489133ce663c009ff42621a647b4c28.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_4489133ce663c009ff42621a647b4c28.jpg already downloaded
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_9d05e07783249f3f74a4bf863933bcc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_9d05e07783249f3f74a4bf863933bcc5.jpg already downloaded
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_d12be34fe6c7569d9d3fcbc9fe94df18.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_d12be34fe6c7569d9d3fcbc9fe94df18.jpg already downloaded
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_15dce6bbc88ca265c0c364796be2e167.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_15dce6bbc88ca265c0c364796be2e167.jpg already downloaded
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_4266dcb1624f49a827b1c5cd7a663ba3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_4266dcb1624f49a827b1c5cd7a663ba3.jpg already downloaded
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_f9a615a60038d937d92247d99ad42bea.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_f9a615a60038d937d92247d99ad42bea.jpg already downloaded
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F40%252Faa40289cc097e849f280dd64dd2e96a9%252Fpa%252FZD10006_c0c9dd5742f99e851af6003833bcdfee.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_c0c9dd5742f99e851af6003833bcdfee.jpg already downloaded
2026-03-28 10:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8, identifier: ZD10006
2026-03-28 10:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a7de50>
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_a90fb2dda13e518ff1c634d02d922510.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_a90fb2dda13e518ff1c634d02d922510.jpg saved to cache
2026-03-28 10:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_a84c3cb633cf18b12abfbbb671d4a7b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006
2026-03-28 10:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006
2026-03-28 10:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 179f74e2-e4af-5acb-99fb-b8a56a7d87c8 with identifier: ZD10006 to the API
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZD10006>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:21:36Z',
 'fuel_type': 'petrol',
 'id': '179f74e2-e4af-5acb-99fb-b8a56a7d87c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD10006',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 132301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_2c9f0f0b12de5007fb051cc04915532a.jpg',
                'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_012a7c045aafa8479d3298a3d4c67eed.jpg',
                'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_e8eab900e010829f4f96a2be9044b33a.jpg',
                'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_4489133ce663c009ff42621a647b4c28.jpg',
                'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_9d05e07783249f3f74a4bf863933bcc5.jpg',
                'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_d12be34fe6c7569d9d3fcbc9fe94df18.jpg',
                'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_15dce6bbc88ca265c0c364796be2e167.jpg',
                'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_4266dcb1624f49a827b1c5cd7a663ba3.jpg',
                'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_f9a615a60038d937d92247d99ad42bea.jpg',
                'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_c0c9dd5742f99e851af6003833bcdfee.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_2c9f0f0b12de5007fb051cc04915532a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_012a7c045aafa8479d3298a3d4c67eed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_e8eab900e010829f4f96a2be9044b33a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_4489133ce663c009ff42621a647b4c28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_9d05e07783249f3f74a4bf863933bcc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_d12be34fe6c7569d9d3fcbc9fe94df18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_15dce6bbc88ca265c0c364796be2e167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_4266dcb1624f49a827b1c5cd7a663ba3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_f9a615a60038d937d92247d99ad42bea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_179f74e2-e4af-5acb-99fb-b8a56a7d87c8/179f74e2-e4af-5acb-99fb-b8a56a7d87c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/40/aa40289cc097e849f280dd64dd2e96a9/pa/ZD10006_c0c9dd5742f99e851af6003833bcdfee.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD10006%27 HTTP/1.1" 200 None
2026-03-28 10:36:40 [auto1.de] INFO: Saving data for ZD10006: {'created_time': 1774694200.971985, 'last_price_update_time': 1774694200.971998, 'auction_closing_time': 1774884096.0}
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD10006') HTTP/1.1" 204 0
2026-03-28 10:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_df33656fb2e806194933edf1ef2a44d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a7d710>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_30c1102954d902e06e726c037666cabe.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_30c1102954d902e06e726c037666cabe.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad6b50>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_c954efd7bf6769571087f7616675988a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_c954efd7bf6769571087f7616675988a.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabecb550>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_c60c5f9846ba1b6b7a73adc677f4224b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_c60c5f9846ba1b6b7a73adc677f4224b.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_2796a28f1838a72dcdfd81acab8fadae.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_d50da5cb9490cbf83db8cd22eb7a1704.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeb2410>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_a84c3cb633cf18b12abfbbb671d4a7b4.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_a84c3cb633cf18b12abfbbb671d4a7b4.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54737d39-fdf4-5dfd-86f5-23815799b0a9
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdf910>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_df33656fb2e806194933edf1ef2a44d6.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_df33656fb2e806194933edf1ef2a44d6.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54737d39-fdf4-5dfd-86f5-23815799b0a9
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeff350>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_2796a28f1838a72dcdfd81acab8fadae.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_2796a28f1838a72dcdfd81acab8fadae.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54737d39-fdf4-5dfd-86f5-23815799b0a9
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd18850>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_d50da5cb9490cbf83db8cd22eb7a1704.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_d50da5cb9490cbf83db8cd22eb7a1704.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54737d39-fdf4-5dfd-86f5-23815799b0a9
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_a8fe53d005a05b40a78e0d0f56d421ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_aab8b02296fd3399acbdab6829876456.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_5eab8fca7130a4d5d15b79c769d97c1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_13f165418fbcecf31e9729a90f3f79dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_def783695e82bf282c6e9a286258bf9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_36abf326d994f78a8a8c3d75d093cacf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd4c3d0>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_a8fe53d005a05b40a78e0d0f56d421ea.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_a8fe53d005a05b40a78e0d0f56d421ea.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfb9e90>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_aab8b02296fd3399acbdab6829876456.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_aab8b02296fd3399acbdab6829876456.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_5410d705f1adc7890bb0a854575c43bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_0f34d800e63e4bbdb9df99bb8a1e6f54.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5f3d0>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_5eab8fca7130a4d5d15b79c769d97c1f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_5eab8fca7130a4d5d15b79c769d97c1f.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc6690>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F7c%252F9a7c4d99251485345e30a1b5c53a712d%252Fpa%252FHA64256_13f165418fbcecf31e9729a90f3f79dc.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_13f165418fbcecf31e9729a90f3f79dc.jpg saved to cache
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b
2026-03-28 10:36:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5b16257-e87c-536c-81c4-4eac4e3c9c7b, skipping ID generation
2026-03-28 10:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b with scrape type 1
2026-03-28 10:36:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5b16257-e87c-536c-81c4-4eac4e3c9c7b sending to next pipeline
2026-03-28 10:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5b16257-e87c-536c-81c4-4eac4e3c9c7b, identifier: HA64256
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdf750>
2026-03-28 10:36:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_def783695e82bf282c6e9a286258bf9c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_def783695e82bf282c6e9a286258bf9c.jpg saved to cache
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256
2026-03-28 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256
2026-03-28 10:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5b16257-e87c-536c-81c4-4eac4e3c9c7b with identifier: HA64256 to the API
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_13f165418fbcecf31e9729a90f3f79dc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:45:07Z',
 'fuel_type': 'diesel',
 'id': 'e5b16257-e87c-536c-81c4-4eac4e3c9c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA64256',
 'listing': 'auction',
 'location': 'DE, Trier',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 230787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_aab8b02296fd3399acbdab6829876456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_bd4bc5f941c73f3229d0f8d2a214f963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2998539,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_a90fb2dda13e518ff1c634d02d922510.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2997602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_30c1102954d902e06e726c037666cabe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3123360,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_c60c5f9846ba1b6b7a73adc677f4224b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2967547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_c954efd7bf6769571087f7616675988a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2980645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_5eab8fca7130a4d5d15b79c769d97c1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_46ea26cb5fd2bf4d0b741a16083d5f53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_13f165418fbcecf31e9729a90f3f79dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5b16257-e87c-536c-81c4-4eac4e3c9c7b/e5b16257-e87c-536c-81c4-4eac4e3c9c7b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/7c/9a7c4d99251485345e30a1b5c53a712d/pa/HA64256_5734fed730faff4071ad864b8c8047f3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium S',
 'transmission': 'manual',
 'trim': 'Titanium S',
 'year': 2013}
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA64256%27 HTTP/1.1" 200 None
2026-03-28 10:36:42 [auto1.de] INFO: Saving data for HA64256: {'created_time': 1774694202.404007, 'last_price_update_time': 1774694202.404022, 'auction_closing_time': 1774885507.0}
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA64256') HTTP/1.1" 204 0
2026-03-28 10:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_bb9939fa3008802e844162d379c8b64a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab96a9210>
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_36abf326d994f78a8a8c3d75d093cacf.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_36abf326d994f78a8a8c3d75d093cacf.jpg saved to cache
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeffa90>
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_5410d705f1adc7890bb0a854575c43bb.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_5410d705f1adc7890bb0a854575c43bb.jpg saved to cache
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe92f50>
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252F75%252F09757b6539902c6d91aa3bca270d2629%252Fpa%252FWD92607_0f34d800e63e4bbdb9df99bb8a1e6f54.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_0f34d800e63e4bbdb9df99bb8a1e6f54.jpg saved to cache
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54737d39-fdf4-5dfd-86f5-23815799b0a9
2026-03-28 10:36:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54737d39-fdf4-5dfd-86f5-23815799b0a9, skipping ID generation
2026-03-28 10:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54737d39-fdf4-5dfd-86f5-23815799b0a9 with scrape type 1
2026-03-28 10:36:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54737d39-fdf4-5dfd-86f5-23815799b0a9 sending to next pipeline
2026-03-28 10:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54737d39-fdf4-5dfd-86f5-23815799b0a9, identifier: WD92607
2026-03-28 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 10:36:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607
2026-03-28 10:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54737d39-fdf4-5dfd-86f5-23815799b0a9 with identifier: WD92607 to the API
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_0f34d800e63e4bbdb9df99bb8a1e6f54.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:27:59Z',
 'fuel_type': 'petrol',
 'id': '54737d39-fdf4-5dfd-86f5-23815799b0a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD92607',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 164426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_60a4127a0f5d8cb3859d1572017a9290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82402,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_0f34d800e63e4bbdb9df99bb8a1e6f54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_d50da5cb9490cbf83db8cd22eb7a1704.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_2796a28f1838a72dcdfd81acab8fadae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_df33656fb2e806194933edf1ef2a44d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54737d39-fdf4-5dfd-86f5-23815799b0a9/54737d39-fdf4-5dfd-86f5-23815799b0a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/75/09757b6539902c6d91aa3bca270d2629/pa/WD92607_a84c3cb633cf18b12abfbbb671d4a7b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-04-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2006}
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Saving data for WD92607: {'created_time': 1774694203.288782, 'last_price_update_time': 1774694203.288791, 'auction_closing_time': 1774884479.0}
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD92607') HTTP/1.1" 204 0
2026-03-28 10:36:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ac8474990>
2026-03-28 10:36:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_bb9939fa3008802e844162d379c8b64a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_bb9939fa3008802e844162d379c8b64a.jpg saved to cache
2026-03-28 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:43 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 9629 | hits on page: 40
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71513%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for GJ71513: 1
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_35c9736dfd6370f28f32b572ed2b6248.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_cbdc84082b0fd6ef520324cb75dc14d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67531%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for XT67531: 2
2026-03-28 10:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531
2026-03-28 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61c1af49-815a-504c-a558-02cf66456752 with scrape type 2
2026-03-28 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61c1af49-815a-504c-a558-02cf66456752 with scrape type 2
2026-03-28 10:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61c1af49-815a-504c-a558-02cf66456752, identifier: XT67531
2026-03-28 10:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531
2026-03-28 10:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531
2026-03-28 10:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61c1af49-815a-504c-a558-02cf66456752 with identifier: XT67531 to the API
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:45:40Z',
 'fuel_type': 'diesel',
 'id': '61c1af49-815a-504c-a558-02cf66456752',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT67531',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 25866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67531%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Saving data for XT67531: {'auction_closing_time': 1774885540.0, 'created_time': 1773400883.719555, 'last_price_update_time': 1774694203.838918}
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT67531') HTTP/1.1" 204 0
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_cb898a92db25c0e6a5152f52cb4bc8af.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:43 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB33753%27 HTTP/1.1" 200 None
2026-03-28 10:36:43 [auto1.de] INFO: Scrape type for PB33753: 2
2026-03-28 10:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753
2026-03-28 10:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4097f511-da79-5ae6-8838-5c787425998b with scrape type 2
2026-03-28 10:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4097f511-da79-5ae6-8838-5c787425998b with scrape type 2
2026-03-28 10:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4097f511-da79-5ae6-8838-5c787425998b, identifier: PB33753
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_897b55eb0f031d7463edd5f9a1e30f47.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_de6cbd7ac3d9a94ba165d21118fe1fa6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753
2026-03-28 10:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 10:36:44 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753
2026-03-28 10:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4097f511-da79-5ae6-8838-5c787425998b with identifier: PB33753 to the API
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 449,
 'expiration_date': '2026-03-30T15:50:30Z',
 'fuel_type': 'hybrid',
 'id': '4097f511-da79-5ae6-8838-5c787425998b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB33753',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 99949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Audi A8 60 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2021}
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB33753%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [auto1.de] INFO: Saving data for PB33753: {'auction_closing_time': 1774885830.0, 'created_time': 1774157730.125484, 'last_price_update_time': 1774694204.604862}
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB33753') HTTP/1.1" 204 0
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a07d50>
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_35c9736dfd6370f28f32b572ed2b6248.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_35c9736dfd6370f28f32b572ed2b6248.jpg saved to cache
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a1bd10>
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_cbdc84082b0fd6ef520324cb75dc14d5.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_cbdc84082b0fd6ef520324cb75dc14d5.jpg saved to cache
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:44 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57767%27 HTTP/1.1" 200 None
2026-03-28 10:36:44 [auto1.de] INFO: Scrape type for TU57767: 2
2026-03-28 10:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767
2026-03-28 10:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with scrape type 2
2026-03-28 10:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with scrape type 2
2026-03-28 10:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df, identifier: TU57767
2026-03-28 10:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_4b1dc674b48cb966981555a73e5f8105.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767
2026-03-28 10:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767
2026-03-28 10:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bb187f1-529f-5012-a4d4-fe1c6e24e1df with identifier: TU57767 to the API
2026-03-28 10:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:45:46Z',
 'fuel_type': 'petrol',
 'id': '1bb187f1-529f-5012-a4d4-fe1c6e24e1df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU57767',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 54108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-07',
 'seller_name': None,
 'title': 'MINI One Essential Trim',
 'transmission': 'automatic',
 'trim': 'Essential Trim',
 'year': 2022}
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57767%27 HTTP/1.1" 200 None
2026-03-28 10:36:45 [auto1.de] INFO: Saving data for TU57767: {'auction_closing_time': 1774885546.0, 'created_time': 1774034539.307449, 'last_price_update_time': 1774694205.211836}
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU57767') HTTP/1.1" 204 0
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR78495%27 HTTP/1.1" 200 None
2026-03-28 10:36:45 [auto1.de] INFO: Scrape type for HR78495: 1
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb6210>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_cb898a92db25c0e6a5152f52cb4bc8af.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_cb898a92db25c0e6a5152f52cb4bc8af.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd3eb90>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_897b55eb0f031d7463edd5f9a1e30f47.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_897b55eb0f031d7463edd5f9a1e30f47.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd3c7d0>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_de6cbd7ac3d9a94ba165d21118fe1fa6.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_de6cbd7ac3d9a94ba165d21118fe1fa6.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_ed0c191f1a1a8c073d15ffe7d8637d4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_e7713d706f884e8a76abd7c4af29fcbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_a419aeaa8d87f5c13d6fe447c2b38a93.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU85035%27 HTTP/1.1" 200 None
2026-03-28 10:36:45 [auto1.de] INFO: Scrape type for RU85035: 1
2026-03-28 10:36:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fc0d0>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_4b1dc674b48cb966981555a73e5f8105.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_4b1dc674b48cb966981555a73e5f8105.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ45584%27 HTTP/1.1" 200 None
2026-03-28 10:36:45 [auto1.de] INFO: Scrape type for VJ45584: 1
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-28 10:36:45 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45344%27 HTTP/1.1" 200 None
2026-03-28 10:36:45 [auto1.de] INFO: Scrape type for UB45344: 1
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe987d0>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_ed0c191f1a1a8c073d15ffe7d8637d4b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_ed0c191f1a1a8c073d15ffe7d8637d4b.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf96a50>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F2c%252F2f2c33c7d2d32433a7b4ce9af52310ee%252Fpa%252FBC15764_e7713d706f884e8a76abd7c4af29fcbf.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_e7713d706f884e8a76abd7c4af29fcbf.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1
2026-03-28 10:36:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 561e8718-84c7-588c-bf25-6bb9f51ff1c1, skipping ID generation
2026-03-28 10:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with scrape type 1
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 561e8718-84c7-588c-bf25-6bb9f51ff1c1 sending to next pipeline
2026-03-28 10:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 561e8718-84c7-588c-bf25-6bb9f51ff1c1, identifier: BC15764
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad7010>
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_a419aeaa8d87f5c13d6fe447c2b38a93.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_a419aeaa8d87f5c13d6fe447c2b38a93.jpg saved to cache
2026-03-28 10:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764
2026-03-28 10:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764
2026-03-28 10:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 561e8718-84c7-588c-bf25-6bb9f51ff1c1 with identifier: BC15764 to the API
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_e7713d706f884e8a76abd7c4af29fcbf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:48:15Z',
 'fuel_type': 'petrol',
 'id': '561e8718-84c7-588c-bf25-6bb9f51ff1c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC15764',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 105416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_cc1a8124b2e686961a44543db8ac4742.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_e7713d706f884e8a76abd7c4af29fcbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_897b55eb0f031d7463edd5f9a1e30f47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_e0963b0839698e6749f3bfa53eeb4aa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_561e8718-84c7-588c-bf25-6bb9f51ff1c1/561e8718-84c7-588c-bf25-6bb9f51ff1c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/2c/2f2c33c7d2d32433a7b4ce9af52310ee/pa/BC15764_de6cbd7ac3d9a94ba165d21118fe1fa6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC15764%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [auto1.de] INFO: Saving data for BC15764: {'created_time': 1774694206.331029, 'last_price_update_time': 1774694206.331041, 'auction_closing_time': 1774885695.0}
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC15764') HTTP/1.1" 204 0
2026-03-28 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_5340b4ecacf2303245f52fc958d6a0a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:46 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-28 10:36:46 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-28 10:36:46 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65282%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [auto1.de] INFO: Scrape type for NF65282: 2
2026-03-28 10:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282
2026-03-28 10:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8b74cfa-2c76-5a7c-8e97-787bfee53098 with scrape type 2
2026-03-28 10:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8b74cfa-2c76-5a7c-8e97-787bfee53098 with scrape type 2
2026-03-28 10:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8b74cfa-2c76-5a7c-8e97-787bfee53098, identifier: NF65282
2026-03-28 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_6409671c0b326dce4744fb5f35bcf81b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_e44e8558e57604d93936ee3ae16fdf7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282
2026-03-28 10:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282
2026-03-28 10:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8b74cfa-2c76-5a7c-8e97-787bfee53098 with identifier: NF65282 to the API
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:23:46Z',
 'fuel_type': 'petrol',
 'id': 'e8b74cfa-2c76-5a7c-8e97-787bfee53098',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF65282',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 120688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-26',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS 245',
 'transmission': 'automatic',
 'trim': 'RS 245',
 'year': 2020}
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65282%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [auto1.de] INFO: Saving data for NF65282: {'auction_closing_time': 1774884226.0, 'created_time': 1774350218.094065, 'last_price_update_time': 1774694206.921954}
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF65282') HTTP/1.1" 204 0
2026-03-28 10:36:46 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-28 10:36:46 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-28 10:36:46 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-28 10:36:46 [auto1.de] INFO: Scrape type for LM10522: 1
2026-03-28 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF54285/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM74850/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdc3d10>
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_5340b4ecacf2303245f52fc958d6a0a5.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_5340b4ecacf2303245f52fc958d6a0a5.jpg saved to cache
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:47 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG29831%27 HTTP/1.1" 200 None
2026-03-28 10:36:47 [auto1.de] INFO: Scrape type for VG29831: 1
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe99210>
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_6409671c0b326dce4744fb5f35bcf81b.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_6409671c0b326dce4744fb5f35bcf81b.jpg saved to cache
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 83a13b29-1f3b-5e38-82de-d63f81df926d
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8910890>
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg61%252Fc0%252F61c0c2181a7a85644e19b342b8e8c347%252Fpa%252FPB91995_e44e8558e57604d93936ee3ae16fdf7a.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_e44e8558e57604d93936ee3ae16fdf7a.jpg saved to cache
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9029eb12-3026-5bac-a54f-3de792aed609
2026-03-28 10:36:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9029eb12-3026-5bac-a54f-3de792aed609, skipping ID generation
2026-03-28 10:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9029eb12-3026-5bac-a54f-3de792aed609 with scrape type 1
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9029eb12-3026-5bac-a54f-3de792aed609 sending to next pipeline
2026-03-28 10:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9029eb12-3026-5bac-a54f-3de792aed609, identifier: PB91995
2026-03-28 10:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9029eb12-3026-5bac-a54f-3de792aed609 with identifier: PB91995
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 10:36:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9029eb12-3026-5bac-a54f-3de792aed609 with identifier: PB91995
2026-03-28 10:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9029eb12-3026-5bac-a54f-3de792aed609 with identifier: PB91995 to the API
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_e44e8558e57604d93936ee3ae16fdf7a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 12,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 534,
 'expiration_date': '2026-03-30T15:04:06Z',
 'fuel_type': 'electro',
 'id': '9029eb12-3026-5bac-a54f-3de792aed609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB91995',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Tesla',
 'model': 'Model Y',
 'odometer': 45886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_e44e8558e57604d93936ee3ae16fdf7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_5340b4ecacf2303245f52fc958d6a0a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_ed0c191f1a1a8c073d15ffe7d8637d4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_35c9736dfd6370f28f32b572ed2b6248.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_cb898a92db25c0e6a5152f52cb4bc8af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_cbdc84082b0fd6ef520324cb75dc14d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_5410d705f1adc7890bb0a854575c43bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71626,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_a8fe53d005a05b40a78e0d0f56d421ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_def783695e82bf282c6e9a286258bf9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9029eb12-3026-5bac-a54f-3de792aed609/9029eb12-3026-5bac-a54f-3de792aed609_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img61/c0/61c0c2181a7a85644e19b342b8e8c347/pa/PB91995_e96e5ec79488c1209621c6aec7f14a75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model Y Performance Dual AWD AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2022}
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB91995%27 HTTP/1.1" 200 None
2026-03-28 10:36:47 [auto1.de] INFO: Saving data for PB91995: {'created_time': 1774694207.715021, 'last_price_update_time': 1774694207.71503, 'auction_closing_time': 1774883046.0}
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB91995') HTTP/1.1" 204 0
2026-03-28 10:36:47 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX51381%27 HTTP/1.1" 200 None
2026-03-28 10:36:47 [auto1.de] INFO: Scrape type for GX51381: 1
2026-03-28 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB66562> (referer: https://www.auto1.com/v1/car-details-view/UB66562/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_b66f83f2aa5b305a12c3ea504cdfe5be.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:47 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-28 10:36:47 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP50016%27 HTTP/1.1" 200 None
2026-03-28 10:36:47 [auto1.de] INFO: Scrape type for YP50016: 2
2026-03-28 10:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016
2026-03-28 10:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with scrape type 2
2026-03-28 10:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with scrape type 2
2026-03-28 10:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99, identifier: YP50016
2026-03-28 10:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016
2026-03-28 10:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016
2026-03-28 10:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99 with identifier: YP50016 to the API
2026-03-28 10:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:09:20Z',
 'fuel_type': 'diesel',
 'id': 'a4b44cf2-9a77-5e81-af0a-0b5ff1dfdc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP50016',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 212946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-22',
 'seller_name': None,
 'title': 'Honda Civic 1.6 DTEC Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2014}
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP50016%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [auto1.de] INFO: Saving data for YP50016: {'auction_closing_time': 1774883360.0, 'created_time': 1774034636.245534, 'last_price_update_time': 1774694208.256381}
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP50016') HTTP/1.1" 204 0
2026-03-28 10:36:48 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-28 10:36:48 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06908%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [auto1.de] INFO: Scrape type for XN06908: 1
2026-03-28 10:36:48 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY64199%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [auto1.de] INFO: Scrape type for SY64199: 1
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZR61272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562
2026-03-28 10:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with scrape type 1
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_8c87858acfe64754dbdb41c470ea9574.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_8c87858acfe64754dbdb41c470ea9574.jpg not downloaded yet
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe9a8d0>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_b66f83f2aa5b305a12c3ea504cdfe5be.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_b66f83f2aa5b305a12c3ea504cdfe5be.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d
2026-03-28 10:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:48 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-28 10:36:48 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_908a0761ca68f323ef17442e8af47d70.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_908a0761ca68f323ef17442e8af47d70.jpg not downloaded yet
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_af5846fe8d748ba73b295695ec167afe.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_af5846fe8d748ba73b295695ec167afe.jpg not downloaded yet
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_7ceb71510b2b5dfe2e142b1e6e8cf358.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_7ceb71510b2b5dfe2e142b1e6e8cf358.jpg not downloaded yet
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_b7b8936675883037fbcd7636955ddcb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_b7b8936675883037fbcd7636955ddcb1.jpg not downloaded yet
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_6fa31638a7d288b1f9f267103a2c8f62.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_6fa31638a7d288b1f9f267103a2c8f62.jpg not downloaded yet
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_92cb0d025b8718a10360f2e67581a170.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_92cb0d025b8718a10360f2e67581a170.jpg not downloaded yet
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_a6a27aa228b435ea69c8fac646b35dcb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_a6a27aa228b435ea69c8fac646b35dcb.jpg not downloaded yet
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_a32dba382065b6dc16bd2fbc36a714ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_a32dba382065b6dc16bd2fbc36a714ac.jpg not downloaded yet
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_134396ca0c744abd703876dbbed82c3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_134396ca0c744abd703876dbbed82c3c.jpg not downloaded yet
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_313183672c7992d352f9aa434657df18.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_3a0155e9624a611dd30d5f6a7e3b1ef5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_8c87858acfe64754dbdb41c470ea9574.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH34221> (referer: https://www.auto1.com/v1/car-details-view/BH34221/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f98d0>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_313183672c7992d352f9aa434657df18.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_313183672c7992d352f9aa434657df18.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfcb990>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252Ff6%252F66f6e80a72ef46f5b69df6011ec51393%252Fpa%252FYW82863_3a0155e9624a611dd30d5f6a7e3b1ef5.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_3a0155e9624a611dd30d5f6a7e3b1ef5.jpg saved to cache
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 773025ac-9114-5ff3-bce6-ad06fcf1366b
2026-03-28 10:36:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 773025ac-9114-5ff3-bce6-ad06fcf1366b, skipping ID generation
2026-03-28 10:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773025ac-9114-5ff3-bce6-ad06fcf1366b with scrape type 1
2026-03-28 10:36:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 773025ac-9114-5ff3-bce6-ad06fcf1366b sending to next pipeline
2026-03-28 10:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 773025ac-9114-5ff3-bce6-ad06fcf1366b, identifier: YW82863
2026-03-28 10:36:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8891f90>
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_8c87858acfe64754dbdb41c470ea9574.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_8c87858acfe64754dbdb41c470ea9574.jpg saved to cache
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221
2026-03-28 10:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with scrape type 1
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_ca32f730932818e43dfe2a3337991aba.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_ca32f730932818e43dfe2a3337991aba.jpg not downloaded yet
2026-03-28 10:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863
2026-03-28 10:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863
2026-03-28 10:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 773025ac-9114-5ff3-bce6-ad06fcf1366b with identifier: YW82863 to the API
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_3a0155e9624a611dd30d5f6a7e3b1ef5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:13:59Z',
 'fuel_type': 'diesel',
 'id': '773025ac-9114-5ff3-bce6-ad06fcf1366b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW82863',
 'listing': 'auction',
 'location': 'DE, Mönchengladbach',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 182810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95515,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_367b5f18f2a06dcdc2013dfdd4872f41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_a419aeaa8d87f5c13d6fe447c2b38a93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3372723,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_3a0155e9624a611dd30d5f6a7e3b1ef5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3397911,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_6406bd3615f6aa290c75d634f71194c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3467530,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_313183672c7992d352f9aa434657df18.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3374577,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_4b1dc674b48cb966981555a73e5f8105.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3473195,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_36abf326d994f78a8a8c3d75d093cacf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_bb9939fa3008802e844162d379c8b64a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_c2500addb5ca6f974913eb1e21ed9cd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_773025ac-9114-5ff3-bce6-ad06fcf1366b/773025ac-9114-5ff3-bce6-ad06fcf1366b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/f6/66f6e80a72ef46f5b69df6011ec51393/pa/YW82863_0c85694409fd640b11c5d57bb1ae366c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Crossland X 1.5 CDTI 120 Jahre',
 'transmission': 'automatic',
 'trim': '120 Jahre',
 'year': 2019}
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW82863%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Saving data for YW82863: {'created_time': 1774694209.615634, 'last_price_update_time': 1774694209.615644, 'auction_closing_time': 1774883639.0}
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW82863') HTTP/1.1" 204 0
2026-03-28 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_134396ca0c744abd703876dbbed82c3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_be324f4ae291650ec42145cf49c73ede.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_be324f4ae291650ec42145cf49c73ede.jpg not downloaded yet
2026-03-28 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ71513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_a60bf473f1bb60c16a1a44f896b7b2cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_a60bf473f1bb60c16a1a44f896b7b2cf.jpg not downloaded yet
2026-03-28 10:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR78495/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_f522323edb085d4c0d93f4b415ac7bbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_f522323edb085d4c0d93f4b415ac7bbd.jpg not downloaded yet
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_48518a7818f9edb792d25f55c8f4075f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_48518a7818f9edb792d25f55c8f4075f.jpg not downloaded yet
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe29d90>
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_134396ca0c744abd703876dbbed82c3c.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_134396ca0c744abd703876dbbed82c3c.jpg saved to cache
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_be324f4ae291650ec42145cf49c73ede.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_ca32f730932818e43dfe2a3337991aba.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:49 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 9629 | hits on page: 40
2026-03-28 10:36:49 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62067%27 HTTP/1.1" 200 None
2026-03-28 10:36:49 [auto1.de] INFO: Scrape type for XV62067: 2
2026-03-28 10:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067
2026-03-28 10:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with scrape type 2
2026-03-28 10:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with scrape type 2
2026-03-28 10:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2, identifier: XV62067
2026-03-28 10:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067
2026-03-28 10:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067
2026-03-28 10:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18d97808-f0bc-552c-8bd0-eeaadb2d7ef2 with identifier: XV62067 to the API
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:41:29Z',
 'fuel_type': 'petrol',
 'id': '18d97808-f0bc-552c-8bd0-eeaadb2d7ef2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV62067',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 164146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-04-29',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1996}
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62067%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Saving data for XV62067: {'auction_closing_time': 1774885289.0, 'created_time': 1773945976.585571, 'last_price_update_time': 1774694210.325445}
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV62067') HTTP/1.1" 204 0
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91582%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Scrape type for EH91582: 1
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_48518a7818f9edb792d25f55c8f4075f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_f522323edb085d4c0d93f4b415ac7bbd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_a6a27aa228b435ea69c8fac646b35dcb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a42250>
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_be324f4ae291650ec42145cf49c73ede.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_be324f4ae291650ec42145cf49c73ede.jpg saved to cache
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc4550>
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_ca32f730932818e43dfe2a3337991aba.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_ca32f730932818e43dfe2a3337991aba.jpg saved to cache
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58819%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Scrape type for SG58819: 2
2026-03-28 10:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819
2026-03-28 10:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12c55a55-ee92-5264-82e0-9b651a1d2289 with scrape type 2
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12c55a55-ee92-5264-82e0-9b651a1d2289 with scrape type 2
2026-03-28 10:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12c55a55-ee92-5264-82e0-9b651a1d2289, identifier: SG58819
2026-03-28 10:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819
2026-03-28 10:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819
2026-03-28 10:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12c55a55-ee92-5264-82e0-9b651a1d2289 with identifier: SG58819 to the API
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 421,
 'expiration_date': '2026-03-30T15:54:21Z',
 'fuel_type': 'petrol',
 'id': '12c55a55-ee92-5264-82e0-9b651a1d2289',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG58819',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'G-Klasse',
 'odometer': 143946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-27',
 'seller_name': None,
 'title': 'Mercedes-Benz G-Klasse G 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58819%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Saving data for SG58819: {'auction_closing_time': 1774886061.0, 'created_time': 1774349913.495331, 'last_price_update_time': 1774694210.868786}
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG58819') HTTP/1.1" 204 0
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE70575%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Scrape type for FE70575: 1
2026-03-28 10:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_a60bf473f1bb60c16a1a44f896b7b2cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:50 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97651%27 HTTP/1.1" 200 None
2026-03-28 10:36:50 [auto1.de] INFO: Scrape type for TK97651: 2
2026-03-28 10:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651
2026-03-28 10:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b75c04b3-7995-515e-9f2f-2cafcaffcafd with scrape type 2
2026-03-28 10:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b75c04b3-7995-515e-9f2f-2cafcaffcafd with scrape type 2
2026-03-28 10:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b75c04b3-7995-515e-9f2f-2cafcaffcafd, identifier: TK97651
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5d5d0>
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_48518a7818f9edb792d25f55c8f4075f.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_48518a7818f9edb792d25f55c8f4075f.jpg saved to cache
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a7cfd0>
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_f522323edb085d4c0d93f4b415ac7bbd.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_f522323edb085d4c0d93f4b415ac7bbd.jpg saved to cache
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8911c10>
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_a6a27aa228b435ea69c8fac646b35dcb.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_a6a27aa228b435ea69c8fac646b35dcb.jpg saved to cache
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651
2026-03-28 10:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651
2026-03-28 10:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b75c04b3-7995-515e-9f2f-2cafcaffcafd with identifier: TK97651 to the API
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:10:29Z',
 'fuel_type': 'diesel',
 'id': 'b75c04b3-7995-515e-9f2f-2cafcaffcafd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK97651',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 199076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-11',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97651%27 HTTP/1.1" 200 None
2026-03-28 10:36:51 [auto1.de] INFO: Saving data for TK97651: {'auction_closing_time': 1774883429.0, 'created_time': 1773946695.393411, 'last_price_update_time': 1774694211.495272}
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK97651') HTTP/1.1" 204 0
2026-03-28 10:36:51 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-28 10:36:51 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-28 10:36:51 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-28 10:36:51 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-28 10:36:51 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER21698%27 HTTP/1.1" 200 None
2026-03-28 10:36:51 [auto1.de] INFO: Scrape type for ER21698: 2
2026-03-28 10:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698
2026-03-28 10:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with scrape type 2
2026-03-28 10:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with scrape type 2
2026-03-28 10:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a, identifier: ER21698
2026-03-28 10:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698
2026-03-28 10:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698
2026-03-28 10:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b3a2def-38e4-533c-8fe9-46a77f4b4c1a with identifier: ER21698 to the API
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'diesel',
 'id': '7b3a2def-38e4-533c-8fe9-46a77f4b4c1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER21698',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 92121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-27',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Business VIP L2',
 'transmission': 'automatic',
 'trim': 'Business VIP L2',
 'year': 2021}
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER21698%27 HTTP/1.1" 200 None
2026-03-28 10:36:51 [auto1.de] INFO: Saving data for ER21698: {'auction_closing_time': 1774884468.0, 'created_time': 1774034765.436798, 'last_price_update_time': 1774694211.952589}
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER21698') HTTP/1.1" 204 0
2026-03-28 10:36:52 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-28 10:36:52 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-28 10:36:52 [auto1.de] INFO: Scrape type for DY33691: 1
2026-03-28 10:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VJ45584/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf97890>
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252F7b%252F867b70d81e58caafbd040edafaec6401%252Fpa%252FBH34221_a60bf473f1bb60c16a1a44f896b7b2cf.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_a60bf473f1bb60c16a1a44f896b7b2cf.jpg saved to cache
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e
2026-03-28 10:36:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e, skipping ID generation
2026-03-28 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with scrape type 1
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e sending to next pipeline
2026-03-28 10:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e, identifier: BH34221
2026-03-28 10:36:52 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-28 10:36:52 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV98635%27 HTTP/1.1" 200 None
2026-03-28 10:36:52 [auto1.de] INFO: Scrape type for WV98635: 2
2026-03-28 10:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635
2026-03-28 10:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7971cec-1407-5682-aca5-7e5d833ea3b9 with scrape type 2
2026-03-28 10:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7971cec-1407-5682-aca5-7e5d833ea3b9 with scrape type 2
2026-03-28 10:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7971cec-1407-5682-aca5-7e5d833ea3b9, identifier: WV98635
2026-03-28 10:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221
2026-03-28 10:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221
2026-03-28 10:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e with identifier: BH34221 to the API
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_a60bf473f1bb60c16a1a44f896b7b2cf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine': '1.4L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:27:16Z',
 'fuel_type': 'petrol',
 'id': 'a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH34221',
 'listing': 'auction',
 'location': 'DE, Esslingen am Neckar',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 89105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_ca32f730932818e43dfe2a3337991aba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_be324f4ae291650ec42145cf49c73ede.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_a60bf473f1bb60c16a1a44f896b7b2cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_f522323edb085d4c0d93f4b415ac7bbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e/a0bc1522-0ca0-5d7e-a080-ecf0dbf6084e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58362,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/7b/867b70d81e58caafbd040edafaec6401/pa/BH34221_48518a7818f9edb792d25f55c8f4075f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1994-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Joy',
 'transmission': 'automatic',
 'trim': 'Joy',
 'year': 1994}
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH34221%27 HTTP/1.1" 200 None
2026-03-28 10:36:52 [auto1.de] INFO: Saving data for BH34221: {'created_time': 1774694212.743347, 'last_price_update_time': 1774694212.743357, 'auction_closing_time': 1774884436.0}
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH34221') HTTP/1.1" 204 0
2026-03-28 10:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635
2026-03-28 10:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635
2026-03-28 10:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7971cec-1407-5682-aca5-7e5d833ea3b9 with identifier: WV98635 to the API
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:00Z',
 'fuel_type': 'petrol',
 'id': 'a7971cec-1407-5682-aca5-7e5d833ea3b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV98635',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 238227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-09',
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV98635%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Saving data for WV98635: {'auction_closing_time': 1774886340.0, 'created_time': 1773380193.808751, 'last_price_update_time': 1774694213.097366}
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV98635') HTTP/1.1" 204 0
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: PS20271
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF26983%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Scrape type for WF26983: 1
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB01809%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Scrape type for PB01809: 1
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA97993%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Scrape type for DA97993: 1
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD84103%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Scrape type for AD84103: 1
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV43592%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Scrape type for NV43592: 1
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL81843%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Scrape type for PL81843: 2
2026-03-28 10:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843
2026-03-28 10:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with scrape type 2
2026-03-28 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with scrape type 2
2026-03-28 10:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f3806e6-ae0e-5507-8814-b80c53bb1b64, identifier: PL81843
2026-03-28 10:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843
2026-03-28 10:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843
2026-03-28 10:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f3806e6-ae0e-5507-8814-b80c53bb1b64 with identifier: PL81843 to the API
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:54:00Z',
 'fuel_type': 'petrol',
 'id': '0f3806e6-ae0e-5507-8814-b80c53bb1b64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL81843',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 177365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-13',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2010}
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL81843%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Saving data for PL81843: {'auction_closing_time': 1774886040.0, 'created_time': 1773946067.150305, 'last_price_update_time': 1774694213.758704}
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL81843') HTTP/1.1" 204 0
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW38185%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Scrape type for WW38185: 1
2026-03-28 10:36:53 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-28 10:36:53 [auto1.de] INFO: Scrape type for UW13690: 2
2026-03-28 10:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690
2026-03-28 10:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dce7078-2a57-5825-87c4-a8037aac5212 with scrape type 2
2026-03-28 10:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dce7078-2a57-5825-87c4-a8037aac5212 with scrape type 2
2026-03-28 10:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dce7078-2a57-5825-87c4-a8037aac5212, identifier: UW13690
2026-03-28 10:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690
2026-03-28 10:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690
2026-03-28 10:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dce7078-2a57-5825-87c4-a8037aac5212 with identifier: UW13690 to the API
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:05:39Z',
 'fuel_type': 'diesel',
 'id': '0dce7078-2a57-5825-87c4-a8037aac5212',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW13690',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 76083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [auto1.de] INFO: Saving data for UW13690: {'auction_closing_time': 1774883139.0, 'created_time': 1774552702.150152, 'last_price_update_time': 1774694214.405863}
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW13690') HTTP/1.1" 204 0
2026-03-28 10:36:54 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW14038%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [auto1.de] INFO: Scrape type for CW14038: 1
2026-03-28 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_6fa31638a7d288b1f9f267103a2c8f62.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX51381/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:54 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [auto1.de] INFO: Scrape type for HS42053: 2
2026-03-28 10:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053
2026-03-28 10:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44147b12-2026-515b-8f70-10bce9503174 with scrape type 2
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44147b12-2026-515b-8f70-10bce9503174 with scrape type 2
2026-03-28 10:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44147b12-2026-515b-8f70-10bce9503174, identifier: HS42053
2026-03-28 10:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053
2026-03-28 10:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053
2026-03-28 10:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44147b12-2026-515b-8f70-10bce9503174 with identifier: HS42053 to the API
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:36:51Z',
 'fuel_type': 'electro',
 'id': '44147b12-2026-515b-8f70-10bce9503174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS42053',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 54253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-19',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2021}
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-28 10:36:54 [auto1.de] INFO: Saving data for HS42053: {'auction_closing_time': 1774885011.0, 'created_time': 1774553211.478106, 'last_price_update_time': 1774694214.877867}
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS42053') HTTP/1.1" 204 0
2026-03-28 10:36:54 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-28 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_92cb0d025b8718a10360f2e67581a170.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88dd950>
2026-03-28 10:36:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_6fa31638a7d288b1f9f267103a2c8f62.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_6fa31638a7d288b1f9f267103a2c8f62.jpg saved to cache
2026-03-28 10:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_b7b8936675883037fbcd7636955ddcb1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG29831/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_a32dba382065b6dc16bd2fbc36a714ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:36:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad1c90>
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_92cb0d025b8718a10360f2e67581a170.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_92cb0d025b8718a10360f2e67581a170.jpg saved to cache
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:36:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88aee50>
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_b7b8936675883037fbcd7636955ddcb1.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_b7b8936675883037fbcd7636955ddcb1.jpg saved to cache
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:36:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc4490>
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_a32dba382065b6dc16bd2fbc36a714ac.jpg') HTTP/1.1" 204 0
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_a32dba382065b6dc16bd2fbc36a714ac.jpg saved to cache
2026-03-28 10:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UB45344/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:36:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP03101> (referer: https://www.auto1.com/v1/car-details-view/EP03101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101
2026-03-28 10:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb5dc92-ba1e-529c-ad3b-24ef5caca626 with scrape type 1
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_a830cd4cba2e1df917c54b968c11d4d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_a830cd4cba2e1df917c54b968c11d4d1.jpg not downloaded yet
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_bad27a00b93e6383bc9c1840eae3e15c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_bad27a00b93e6383bc9c1840eae3e15c.jpg not downloaded yet
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_5773b7835ff0f7e3cd58cef155e59f73.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5773b7835ff0f7e3cd58cef155e59f73.jpg not downloaded yet
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_f46d46fbed347a3a0090fe23c0afb77b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_f46d46fbed347a3a0090fe23c0afb77b.jpg not downloaded yet
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_19bcec3ea5dd4934e6e63a114f924536.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_19bcec3ea5dd4934e6e63a114f924536.jpg not downloaded yet
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_691827a5deeb348cc3f3d2723ac0f45a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_691827a5deeb348cc3f3d2723ac0f45a.jpg not downloaded yet
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_5d40958266e31561dfdfd03f3345636b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5d40958266e31561dfdfd03f3345636b.jpg not downloaded yet
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_3acfe662338814190ef2043a276368ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_3acfe662338814190ef2043a276368ac.jpg not downloaded yet
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_14ead832816d35ec700b295249dacadc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_14ead832816d35ec700b295249dacadc.jpg not downloaded yet
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_5116b526ff7f86ad94ea1a48c2a123c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5116b526ff7f86ad94ea1a48c2a123c5.jpg not downloaded yet
2026-03-28 10:37:06 [scrapy.extensions.logstats] INFO: Crawled 71 pages (at 56 pages/min), scraped 53 items (at 45 items/min)
2026-03-28 10:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-28 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR78495> (referer: https://www.auto1.com/v1/car-details-view/HR78495/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495
2026-03-28 10:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with scrape type 1
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_9720879e5c412b3ee4a1c990c529cf00.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_9720879e5c412b3ee4a1c990c529cf00.jpg not downloaded yet
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_265999f1d5a38d2be3f1ae69d8553c6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_265999f1d5a38d2be3f1ae69d8553c6b.jpg not downloaded yet
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_c216784507f09d26f85870cd22eced90.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_c216784507f09d26f85870cd22eced90.jpg not downloaded yet
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_a6740ab9d7b356e3b0215e6c507dafbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_a6740ab9d7b356e3b0215e6c507dafbf.jpg not downloaded yet
2026-03-28 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5116b526ff7f86ad94ea1a48c2a123c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_68362bd4d7be00e6318167cc230c5862.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_68362bd4d7be00e6318167cc230c5862.jpg not downloaded yet
2026-03-28 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_a6740ab9d7b356e3b0215e6c507dafbf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd513d0>
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_5116b526ff7f86ad94ea1a48c2a123c5.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5116b526ff7f86ad94ea1a48c2a123c5.jpg saved to cache
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8a650>
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_a6740ab9d7b356e3b0215e6c507dafbf.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_a6740ab9d7b356e3b0215e6c507dafbf.jpg saved to cache
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a
2026-03-28 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_68362bd4d7be00e6318167cc230c5862.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad1e90>
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_68362bd4d7be00e6318167cc230c5862.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_68362bd4d7be00e6318167cc230c5862.jpg saved to cache
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a
2026-03-28 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_c216784507f09d26f85870cd22eced90.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_265999f1d5a38d2be3f1ae69d8553c6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf62d90>
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_c216784507f09d26f85870cd22eced90.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_c216784507f09d26f85870cd22eced90.jpg saved to cache
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a
2026-03-28 10:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_9720879e5c412b3ee4a1c990c529cf00.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc0310>
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_265999f1d5a38d2be3f1ae69d8553c6b.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_265999f1d5a38d2be3f1ae69d8553c6b.jpg saved to cache
2026-03-28 10:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a
2026-03-28 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdcd10>
2026-03-28 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F4a%252Faa4a8b208ce239018b3831c14b97ccf6%252Fpa%252FHR78495_9720879e5c412b3ee4a1c990c529cf00.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_9720879e5c412b3ee4a1c990c529cf00.jpg saved to cache
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a
2026-03-28 10:37:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a, skipping ID generation
2026-03-28 10:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with scrape type 1
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a sending to next pipeline
2026-03-28 10:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a, identifier: HR78495
2026-03-28 10:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495
2026-03-28 10:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495
2026-03-28 10:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d4587a8-cf35-5bc1-88a2-55a4d6348a0a with identifier: HR78495 to the API
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_9720879e5c412b3ee4a1c990c529cf00.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:45:48Z',
 'fuel_type': 'petrol',
 'id': '1d4587a8-cf35-5bc1-88a2-55a4d6348a0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR78495',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 244554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_9720879e5c412b3ee4a1c990c529cf00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_265999f1d5a38d2be3f1ae69d8553c6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_c216784507f09d26f85870cd22eced90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_a6740ab9d7b356e3b0215e6c507dafbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d4587a8-cf35-5bc1-88a2-55a4d6348a0a/1d4587a8-cf35-5bc1-88a2-55a4d6348a0a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/4a/aa4a8b208ce239018b3831c14b97ccf6/pa/HR78495_68362bd4d7be00e6318167cc230c5862.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR78495%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [auto1.de] INFO: Saving data for HR78495: {'created_time': 1774694231.535546, 'last_price_update_time': 1774694231.535557, 'auction_closing_time': 1774885548.0}
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR78495') HTTP/1.1" 204 0
2026-03-28 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ71513> (referer: https://www.auto1.com/v1/car-details-view/GJ71513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_14ead832816d35ec700b295249dacadc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513
2026-03-28 10:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcc87069-f6a2-5836-8bb9-53c3df7f289b with scrape type 1
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_c76fa84f3b6935c2e37ea9d1e6ff4783.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_c76fa84f3b6935c2e37ea9d1e6ff4783.jpg not downloaded yet
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_719d592a97234b87b1684ca9fdcf4c25.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_719d592a97234b87b1684ca9fdcf4c25.jpg not downloaded yet
2026-03-28 10:37:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd53c90>
2026-03-28 10:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_14ead832816d35ec700b295249dacadc.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_14ead832816d35ec700b295249dacadc.jpg saved to cache
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_b24bad66c73860be78f2994bfb40cac8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_b24bad66c73860be78f2994bfb40cac8.jpg not downloaded yet
2026-03-28 10:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5d40958266e31561dfdfd03f3345636b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_a9fdeb61d9c6b8bf8f2917d04e20f50e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_a9fdeb61d9c6b8bf8f2917d04e20f50e.jpg not downloaded yet
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_28a10275449fd6bf26d303947ee31f42.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_28a10275449fd6bf26d303947ee31f42.jpg not downloaded yet
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_590202cc458c38d22ed944673950d428.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_590202cc458c38d22ed944673950d428.jpg not downloaded yet
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_1c8306233fb0f205765ed758ae0c059d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_1c8306233fb0f205765ed758ae0c059d.jpg not downloaded yet
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_9110007c9aeebd9371eee863b8ee6de9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_9110007c9aeebd9371eee863b8ee6de9.jpg not downloaded yet
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_bc0a8e08f9b74a261b7ddd7956238e9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_bc0a8e08f9b74a261b7ddd7956238e9d.jpg not downloaded yet
2026-03-28 10:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_7bed650655c90cc8903477b2f1e39cce.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_7bed650655c90cc8903477b2f1e39cce.jpg not downloaded yet
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe30510>
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_5d40958266e31561dfdfd03f3345636b.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5d40958266e31561dfdfd03f3345636b.jpg saved to cache
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_3acfe662338814190ef2043a276368ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd19a90>
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_3acfe662338814190ef2043a276368ac.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_3acfe662338814190ef2043a276368ac.jpg saved to cache
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_7bed650655c90cc8903477b2f1e39cce.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda7b90>
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_7bed650655c90cc8903477b2f1e39cce.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_7bed650655c90cc8903477b2f1e39cce.jpg saved to cache
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_bc0a8e08f9b74a261b7ddd7956238e9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd53090>
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_bc0a8e08f9b74a261b7ddd7956238e9d.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_bc0a8e08f9b74a261b7ddd7956238e9d.jpg saved to cache
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_9110007c9aeebd9371eee863b8ee6de9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA47251> (referer: https://www.auto1.com/v1/car-details-view/WA47251/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_590202cc458c38d22ed944673950d428.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda4f90>
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_9110007c9aeebd9371eee863b8ee6de9.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_9110007c9aeebd9371eee863b8ee6de9.jpg saved to cache
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251
2026-03-28 10:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with scrape type 1
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_8111373c640351708152e4d72bef7827.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_8111373c640351708152e4d72bef7827.jpg not downloaded yet
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe30710>
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_590202cc458c38d22ed944673950d428.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_590202cc458c38d22ed944673950d428.jpg saved to cache
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_166a686cf4354cff20b38cc51b241cbc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_166a686cf4354cff20b38cc51b241cbc.jpg not downloaded yet
2026-03-28 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_28a10275449fd6bf26d303947ee31f42.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_719d592a97234b87b1684ca9fdcf4c25.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_dff5fbc4f8d43542bfe8d3e82f3f6308.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_dff5fbc4f8d43542bfe8d3e82f3f6308.jpg not downloaded yet
2026-03-28 10:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_9e7f8c6f27e8f4fd1dbe85c1147e1c1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_9e7f8c6f27e8f4fd1dbe85c1147e1c1d.jpg not downloaded yet
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_3bf3e0cb49333a81fe1e9780635b2f57.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_3bf3e0cb49333a81fe1e9780635b2f57.jpg not downloaded yet
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_5f99745c5f9dfb6b33e008dabc9a386c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_5f99745c5f9dfb6b33e008dabc9a386c.jpg not downloaded yet
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_f23f3a5d4aa8791bfb43ef7cd4824b8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_f23f3a5d4aa8791bfb43ef7cd4824b8b.jpg not downloaded yet
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_bb171e0f1f9c75dd4da5f65a3f6ec588.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_bb171e0f1f9c75dd4da5f65a3f6ec588.jpg not downloaded yet
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_9c829e1ff45d240de402e002fc90bc9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_9c829e1ff45d240de402e002fc90bc9b.jpg not downloaded yet
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88c8090>
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_28a10275449fd6bf26d303947ee31f42.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_28a10275449fd6bf26d303947ee31f42.jpg saved to cache
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a40990>
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_719d592a97234b87b1684ca9fdcf4c25.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_719d592a97234b87b1684ca9fdcf4c25.jpg saved to cache
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_466573e1d8d85924482bc3c3d746b1ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_466573e1d8d85924482bc3c3d746b1ed.jpg not downloaded yet
2026-03-28 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_166a686cf4354cff20b38cc51b241cbc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_1c8306233fb0f205765ed758ae0c059d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_8111373c640351708152e4d72bef7827.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_466573e1d8d85924482bc3c3d746b1ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe04350>
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_166a686cf4354cff20b38cc51b241cbc.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_166a686cf4354cff20b38cc51b241cbc.jpg saved to cache
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a72e10>
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_1c8306233fb0f205765ed758ae0c059d.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_1c8306233fb0f205765ed758ae0c059d.jpg saved to cache
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeb3a10>
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_8111373c640351708152e4d72bef7827.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_8111373c640351708152e4d72bef7827.jpg saved to cache
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_9c829e1ff45d240de402e002fc90bc9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f9190>
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_466573e1d8d85924482bc3c3d746b1ed.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_466573e1d8d85924482bc3c3d746b1ed.jpg saved to cache
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5b290>
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_9c829e1ff45d240de402e002fc90bc9b.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_9c829e1ff45d240de402e002fc90bc9b.jpg saved to cache
2026-03-28 10:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_bb171e0f1f9c75dd4da5f65a3f6ec588.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_f23f3a5d4aa8791bfb43ef7cd4824b8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fe450>
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_bb171e0f1f9c75dd4da5f65a3f6ec588.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_bb171e0f1f9c75dd4da5f65a3f6ec588.jpg saved to cache
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_3bf3e0cb49333a81fe1e9780635b2f57.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5b790>
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_f23f3a5d4aa8791bfb43ef7cd4824b8b.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_f23f3a5d4aa8791bfb43ef7cd4824b8b.jpg saved to cache
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_9e7f8c6f27e8f4fd1dbe85c1147e1c1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WW38185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_dff5fbc4f8d43542bfe8d3e82f3f6308.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd46750>
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_3bf3e0cb49333a81fe1e9780635b2f57.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_3bf3e0cb49333a81fe1e9780635b2f57.jpg saved to cache
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_a9fdeb61d9c6b8bf8f2917d04e20f50e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf58390>
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_9e7f8c6f27e8f4fd1dbe85c1147e1c1d.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_9e7f8c6f27e8f4fd1dbe85c1147e1c1d.jpg saved to cache
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf62410>
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_dff5fbc4f8d43542bfe8d3e82f3f6308.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_dff5fbc4f8d43542bfe8d3e82f3f6308.jpg saved to cache
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd3e810>
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_a9fdeb61d9c6b8bf8f2917d04e20f50e.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_a9fdeb61d9c6b8bf8f2917d04e20f50e.jpg saved to cache
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_b24bad66c73860be78f2994bfb40cac8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_5f99745c5f9dfb6b33e008dabc9a386c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf68cd0>
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_b24bad66c73860be78f2994bfb40cac8.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_b24bad66c73860be78f2994bfb40cac8.jpg saved to cache
2026-03-28 10:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe37d10>
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252Fc1%252F29c119baa2d682d08b3feb0a57f565ce%252Fpa%252FWA47251_5f99745c5f9dfb6b33e008dabc9a386c.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_5f99745c5f9dfb6b33e008dabc9a386c.jpg saved to cache
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f
2026-03-28 10:37:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f, skipping ID generation
2026-03-28 10:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with scrape type 1
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 016bcf8d-8f85-5ed7-9177-03a81ff48f2f sending to next pipeline
2026-03-28 10:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f, identifier: WA47251
2026-03-28 10:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251
2026-03-28 10:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251
2026-03-28 10:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 016bcf8d-8f85-5ed7-9177-03a81ff48f2f with identifier: WA47251 to the API
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_5f99745c5f9dfb6b33e008dabc9a386c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.3L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:34:15Z',
 'fuel_type': 'petrol',
 'id': '016bcf8d-8f85-5ed7-9177-03a81ff48f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA47251',
 'listing': 'auction',
 'location': 'DE, Dresden',
 'make': 'Toyota',
 'model': 'Verso-S',
 'odometer': 56588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2499009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_8111373c640351708152e4d72bef7827.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_166a686cf4354cff20b38cc51b241cbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2661107,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_dff5fbc4f8d43542bfe8d3e82f3f6308.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_9e7f8c6f27e8f4fd1dbe85c1147e1c1d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_3bf3e0cb49333a81fe1e9780635b2f57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_5f99745c5f9dfb6b33e008dabc9a386c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_f23f3a5d4aa8791bfb43ef7cd4824b8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_bb171e0f1f9c75dd4da5f65a3f6ec588.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_9c829e1ff45d240de402e002fc90bc9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_016bcf8d-8f85-5ed7-9177-03a81ff48f2f/016bcf8d-8f85-5ed7-9177-03a81ff48f2f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2544790,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img29/c1/29c119baa2d682d08b3feb0a57f565ce/pa/WA47251_466573e1d8d85924482bc3c3d746b1ed.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Verso-S 1.33 Dual VVT-i Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2012}
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA47251%27 HTTP/1.1" 200 None
2026-03-28 10:37:15 [auto1.de] INFO: Saving data for WA47251: {'created_time': 1774694235.697099, 'last_price_update_time': 1774694235.697112, 'auction_closing_time': 1774884855.0}
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA47251') HTTP/1.1" 204 0
2026-03-28 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_691827a5deeb348cc3f3d2723ac0f45a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_19bcec3ea5dd4934e6e63a114f924536.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_c76fa84f3b6935c2e37ea9d1e6ff4783.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fcdd0>
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_691827a5deeb348cc3f3d2723ac0f45a.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_691827a5deeb348cc3f3d2723ac0f45a.jpg saved to cache
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf737d0>
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_19bcec3ea5dd4934e6e63a114f924536.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_19bcec3ea5dd4934e6e63a114f924536.jpg saved to cache
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a07090>
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F51%252Fb351115db7f160b2be648d8d9677560e%252Fpa%252FGJ71513_c76fa84f3b6935c2e37ea9d1e6ff4783.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_c76fa84f3b6935c2e37ea9d1e6ff4783.jpg saved to cache
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcc87069-f6a2-5836-8bb9-53c3df7f289b
2026-03-28 10:37:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcc87069-f6a2-5836-8bb9-53c3df7f289b, skipping ID generation
2026-03-28 10:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcc87069-f6a2-5836-8bb9-53c3df7f289b with scrape type 1
2026-03-28 10:37:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcc87069-f6a2-5836-8bb9-53c3df7f289b sending to next pipeline
2026-03-28 10:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcc87069-f6a2-5836-8bb9-53c3df7f289b, identifier: GJ71513
2026-03-28 10:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513
2026-03-28 10:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513
2026-03-28 10:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcc87069-f6a2-5836-8bb9-53c3df7f289b with identifier: GJ71513 to the API
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_c76fa84f3b6935c2e37ea9d1e6ff4783.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:02Z',
 'fuel_type': 'diesel',
 'id': 'fcc87069-f6a2-5836-8bb9-53c3df7f289b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ71513',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 169877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3227227,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_c76fa84f3b6935c2e37ea9d1e6ff4783.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3069538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_719d592a97234b87b1684ca9fdcf4c25.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_b24bad66c73860be78f2994bfb40cac8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2939309,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_a9fdeb61d9c6b8bf8f2917d04e20f50e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_28a10275449fd6bf26d303947ee31f42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_590202cc458c38d22ed944673950d428.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3068202,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_1c8306233fb0f205765ed758ae0c059d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3136378,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_9110007c9aeebd9371eee863b8ee6de9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_bc0a8e08f9b74a261b7ddd7956238e9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcc87069-f6a2-5836-8bb9-53c3df7f289b/fcc87069-f6a2-5836-8bb9-53c3df7f289b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/51/b351115db7f160b2be648d8d9677560e/pa/GJ71513_7bed650655c90cc8903477b2f1e39cce.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71513%27 HTTP/1.1" 200 None
2026-03-28 10:37:16 [auto1.de] INFO: Saving data for GJ71513: {'created_time': 1774694236.473767, 'last_price_update_time': 1774694236.473778, 'auction_closing_time': 1774883762.0}
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ71513') HTTP/1.1" 204 0
2026-03-28 10:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5773b7835ff0f7e3cd58cef155e59f73.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_bad27a00b93e6383bc9c1840eae3e15c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_f46d46fbed347a3a0090fe23c0afb77b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba81c250>
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_5773b7835ff0f7e3cd58cef155e59f73.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5773b7835ff0f7e3cd58cef155e59f73.jpg saved to cache
2026-03-28 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88c99d0>
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_bad27a00b93e6383bc9c1840eae3e15c.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_bad27a00b93e6383bc9c1840eae3e15c.jpg saved to cache
2026-03-28 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a04050>
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_f46d46fbed347a3a0090fe23c0afb77b.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_f46d46fbed347a3a0090fe23c0afb77b.jpg saved to cache
2026-03-28 10:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_a830cd4cba2e1df917c54b968c11d4d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdcb10>
2026-03-28 10:37:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F02%252F6c0261acb9af09ac63eaa597b1bbc4ad%252Fpa%252FEP03101_a830cd4cba2e1df917c54b968c11d4d1.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_a830cd4cba2e1df917c54b968c11d4d1.jpg saved to cache
2026-03-28 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efb5dc92-ba1e-529c-ad3b-24ef5caca626
2026-03-28 10:37:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efb5dc92-ba1e-529c-ad3b-24ef5caca626, skipping ID generation
2026-03-28 10:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb5dc92-ba1e-529c-ad3b-24ef5caca626 with scrape type 1
2026-03-28 10:37:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efb5dc92-ba1e-529c-ad3b-24ef5caca626 sending to next pipeline
2026-03-28 10:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efb5dc92-ba1e-529c-ad3b-24ef5caca626, identifier: EP03101
2026-03-28 10:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101
2026-03-28 10:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101
2026-03-28 10:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efb5dc92-ba1e-529c-ad3b-24ef5caca626 with identifier: EP03101 to the API
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_a830cd4cba2e1df917c54b968c11d4d1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:26:13Z',
 'fuel_type': 'diesel',
 'id': 'efb5dc92-ba1e-529c-ad3b-24ef5caca626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP03101',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 162474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_a830cd4cba2e1df917c54b968c11d4d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2751640,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_bad27a00b93e6383bc9c1840eae3e15c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2889318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5773b7835ff0f7e3cd58cef155e59f73.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578070,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_f46d46fbed347a3a0090fe23c0afb77b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_19bcec3ea5dd4934e6e63a114f924536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_691827a5deeb348cc3f3d2723ac0f45a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5d40958266e31561dfdfd03f3345636b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2938906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_3acfe662338814190ef2043a276368ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2971516,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_14ead832816d35ec700b295249dacadc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efb5dc92-ba1e-529c-ad3b-24ef5caca626/efb5dc92-ba1e-529c-ad3b-24ef5caca626_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/02/6c0261acb9af09ac63eaa597b1bbc4ad/pa/EP03101_5116b526ff7f86ad94ea1a48c2a123c5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP03101%27 HTTP/1.1" 200 None
2026-03-28 10:37:17 [auto1.de] INFO: Saving data for EP03101: {'created_time': 1774694237.621273, 'last_price_update_time': 1774694237.621286, 'auction_closing_time': 1774884373.0}
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP03101') HTTP/1.1" 204 0
2026-03-28 10:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG29831> (referer: https://www.auto1.com/v1/car-details-view/VG29831/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831
2026-03-28 10:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with scrape type 1
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_81a594cbe9409b7325c92d39292032b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_81a594cbe9409b7325c92d39292032b1.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_8bf79aab161ba1291dd110101b2700a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_8bf79aab161ba1291dd110101b2700a9.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_4ae8a80594cde9104faee47cee918291.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_4ae8a80594cde9104faee47cee918291.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_341b689bf6b775bcd429283959ca9785.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_341b689bf6b775bcd429283959ca9785.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_38fed638dfdffdc3b243c16518485ccc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_38fed638dfdffdc3b243c16518485ccc.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_c12160e7e797563eab3ca2a88a4e2104.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_c12160e7e797563eab3ca2a88a4e2104.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_4fee13eac7af9981a94a0c08465a57ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_4fee13eac7af9981a94a0c08465a57ba.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_d5dd6434281b5131a20a198330be5b99.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_d5dd6434281b5131a20a198330be5b99.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_6574b844d78c7351691b509643b5695f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_6574b844d78c7351691b509643b5695f.jpg not downloaded yet
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_b5444dd2db9086c249e3fbe4a9080201.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_b5444dd2db9086c249e3fbe4a9080201.jpg not downloaded yet
2026-03-28 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV43592/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_b5444dd2db9086c249e3fbe4a9080201.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd45190>
2026-03-28 10:37:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_b5444dd2db9086c249e3fbe4a9080201.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_b5444dd2db9086c249e3fbe4a9080201.jpg saved to cache
2026-03-28 10:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX51381> (referer: https://www.auto1.com/v1/car-details-view/GX51381/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381
2026-03-28 10:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71515936-d968-56b2-a834-e33fb484c195 with scrape type 1
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_9b98af29ba853d63f03d965f3d201037.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_9b98af29ba853d63f03d965f3d201037.jpg not downloaded yet
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_be01513879b2dc845bbb163d7571a9aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_be01513879b2dc845bbb163d7571a9aa.jpg not downloaded yet
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_d09f6ba30572b39256f407834b5f1a8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_d09f6ba30572b39256f407834b5f1a8a.jpg not downloaded yet
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_8147f474bf61fb81c1c5d46ebafe7662.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_8147f474bf61fb81c1c5d46ebafe7662.jpg not downloaded yet
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_489d40d28a3f47815383ec3eb53b10e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_489d40d28a3f47815383ec3eb53b10e5.jpg not downloaded yet
2026-03-28 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_6574b844d78c7351691b509643b5695f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_f731822b816beef1b556c07058b8bc38.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_f731822b816beef1b556c07058b8bc38.jpg not downloaded yet
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_4d3003e21e6a50563ddccd70410dae7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_4d3003e21e6a50563ddccd70410dae7e.jpg not downloaded yet
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_0a270046097ccc2877b73e5ca5c147e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_0a270046097ccc2877b73e5ca5c147e7.jpg not downloaded yet
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_501c55caca7d80ebde57c35731cc3c94.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_501c55caca7d80ebde57c35731cc3c94.jpg not downloaded yet
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_6f798627f6dbd9e695e262a8ab181166.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_6f798627f6dbd9e695e262a8ab181166.jpg not downloaded yet
2026-03-28 10:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f98d0>
2026-03-28 10:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_6574b844d78c7351691b509643b5695f.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_6574b844d78c7351691b509643b5695f.jpg saved to cache
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_489d40d28a3f47815383ec3eb53b10e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a07150>
2026-03-28 10:37:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_489d40d28a3f47815383ec3eb53b10e5.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_489d40d28a3f47815383ec3eb53b10e5.jpg saved to cache
2026-03-28 10:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_6f798627f6dbd9e695e262a8ab181166.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8a610>
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_6f798627f6dbd9e695e262a8ab181166.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_6f798627f6dbd9e695e262a8ab181166.jpg saved to cache
2026-03-28 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_501c55caca7d80ebde57c35731cc3c94.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a04950>
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_501c55caca7d80ebde57c35731cc3c94.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_501c55caca7d80ebde57c35731cc3c94.jpg saved to cache
2026-03-28 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_0a270046097ccc2877b73e5ca5c147e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab891a950>
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_0a270046097ccc2877b73e5ca5c147e7.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_0a270046097ccc2877b73e5ca5c147e7.jpg saved to cache
2026-03-28 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_4d3003e21e6a50563ddccd70410dae7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef5110>
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_4d3003e21e6a50563ddccd70410dae7e.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_4d3003e21e6a50563ddccd70410dae7e.jpg saved to cache
2026-03-28 10:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_f731822b816beef1b556c07058b8bc38.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad3390>
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_f731822b816beef1b556c07058b8bc38.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_f731822b816beef1b556c07058b8bc38.jpg saved to cache
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_8147f474bf61fb81c1c5d46ebafe7662.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdf790>
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_8147f474bf61fb81c1c5d46ebafe7662.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_8147f474bf61fb81c1c5d46ebafe7662.jpg saved to cache
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_d09f6ba30572b39256f407834b5f1a8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8afd0>
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_d09f6ba30572b39256f407834b5f1a8a.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_d09f6ba30572b39256f407834b5f1a8a.jpg saved to cache
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_be01513879b2dc845bbb163d7571a9aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc08a90>
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_be01513879b2dc845bbb163d7571a9aa.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_be01513879b2dc845bbb163d7571a9aa.jpg saved to cache
2026-03-28 10:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_9b98af29ba853d63f03d965f3d201037.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a42cd0>
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc0%252Ff8%252Fc0f8917bb634417a33bd6e89f1b30ee6%252Fpa%252FGX51381_9b98af29ba853d63f03d965f3d201037.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_9b98af29ba853d63f03d965f3d201037.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71515936-d968-56b2-a834-e33fb484c195
2026-03-28 10:37:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71515936-d968-56b2-a834-e33fb484c195, skipping ID generation
2026-03-28 10:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71515936-d968-56b2-a834-e33fb484c195 with scrape type 1
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71515936-d968-56b2-a834-e33fb484c195 sending to next pipeline
2026-03-28 10:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71515936-d968-56b2-a834-e33fb484c195, identifier: GX51381
2026-03-28 10:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381
2026-03-28 10:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381
2026-03-28 10:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71515936-d968-56b2-a834-e33fb484c195 with identifier: GX51381 to the API
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_9b98af29ba853d63f03d965f3d201037.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 186,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:56Z',
 'fuel_type': 'petrol',
 'id': '71515936-d968-56b2-a834-e33fb484c195',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX51381',
 'listing': 'auction',
 'location': 'DE, Velen-Ramsdorf',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 55455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638220,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_9b98af29ba853d63f03d965f3d201037.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_be01513879b2dc845bbb163d7571a9aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_d09f6ba30572b39256f407834b5f1a8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687705,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_8147f474bf61fb81c1c5d46ebafe7662.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_489d40d28a3f47815383ec3eb53b10e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_f731822b816beef1b556c07058b8bc38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2348512,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_4d3003e21e6a50563ddccd70410dae7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2651923,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_0a270046097ccc2877b73e5ca5c147e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2453306,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_501c55caca7d80ebde57c35731cc3c94.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71515936-d968-56b2-a834-e33fb484c195/71515936-d968-56b2-a834-e33fb484c195_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc0/f8/c0f8917bb634417a33bd6e89f1b30ee6/pa/GX51381_6f798627f6dbd9e695e262a8ab181166.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2021}
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX51381%27 HTTP/1.1" 200 None
2026-03-28 10:37:53 [auto1.de] INFO: Saving data for GX51381: {'created_time': 1774694273.6877, 'last_price_update_time': 1774694273.687712, 'auction_closing_time': 1774883336.0}
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX51381') HTTP/1.1" 204 0
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_d5dd6434281b5131a20a198330be5b99.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a0ce50>
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_d5dd6434281b5131a20a198330be5b99.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_d5dd6434281b5131a20a198330be5b99.jpg saved to cache
2026-03-28 10:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_4fee13eac7af9981a94a0c08465a57ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a05710>
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_4fee13eac7af9981a94a0c08465a57ba.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_4fee13eac7af9981a94a0c08465a57ba.jpg saved to cache
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_c12160e7e797563eab3ca2a88a4e2104.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8b910>
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_c12160e7e797563eab3ca2a88a4e2104.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_c12160e7e797563eab3ca2a88a4e2104.jpg saved to cache
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_38fed638dfdffdc3b243c16518485ccc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88cb810>
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_38fed638dfdffdc3b243c16518485ccc.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_38fed638dfdffdc3b243c16518485ccc.jpg saved to cache
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_341b689bf6b775bcd429283959ca9785.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8b850>
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_341b689bf6b775bcd429283959ca9785.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_341b689bf6b775bcd429283959ca9785.jpg saved to cache
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_4ae8a80594cde9104faee47cee918291.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a71250>
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_4ae8a80594cde9104faee47cee918291.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_4ae8a80594cde9104faee47cee918291.jpg saved to cache
2026-03-28 10:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_8bf79aab161ba1291dd110101b2700a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a05710>
2026-03-28 10:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_8bf79aab161ba1291dd110101b2700a9.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_8bf79aab161ba1291dd110101b2700a9.jpg saved to cache
2026-03-28 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_81a594cbe9409b7325c92d39292032b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:37:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a429d0>
2026-03-28 10:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F00%252Fe7003af33e52be3c8e2062c78fc31b8f%252Fpa%252FVG29831_81a594cbe9409b7325c92d39292032b1.jpg') HTTP/1.1" 204 0
2026-03-28 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_81a594cbe9409b7325c92d39292032b1.jpg saved to cache
2026-03-28 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34
2026-03-28 10:37:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6c7c0a9-8c10-5695-be4f-4099aeac8b34, skipping ID generation
2026-03-28 10:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with scrape type 1
2026-03-28 10:37:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6c7c0a9-8c10-5695-be4f-4099aeac8b34 sending to next pipeline
2026-03-28 10:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6c7c0a9-8c10-5695-be4f-4099aeac8b34, identifier: VG29831
2026-03-28 10:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831
2026-03-28 10:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831
2026-03-28 10:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6c7c0a9-8c10-5695-be4f-4099aeac8b34 with identifier: VG29831 to the API
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_81a594cbe9409b7325c92d39292032b1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:17:42Z',
 'fuel_type': 'petrol',
 'id': 'e6c7c0a9-8c10-5695-be4f-4099aeac8b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG29831',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 87251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2407201,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_81a594cbe9409b7325c92d39292032b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_8bf79aab161ba1291dd110101b2700a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_4ae8a80594cde9104faee47cee918291.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2199418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_341b689bf6b775bcd429283959ca9785.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_38fed638dfdffdc3b243c16518485ccc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2325376,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_c12160e7e797563eab3ca2a88a4e2104.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2162406,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_4fee13eac7af9981a94a0c08465a57ba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2289668,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_d5dd6434281b5131a20a198330be5b99.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_6574b844d78c7351691b509643b5695f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6c7c0a9-8c10-5695-be4f-4099aeac8b34/e6c7c0a9-8c10-5695-be4f-4099aeac8b34_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2735694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/00/e7003af33e52be3c8e2062c78fc31b8f/pa/VG29831_b5444dd2db9086c249e3fbe4a9080201.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2015}
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG29831%27 HTTP/1.1" 200 None
2026-03-28 10:37:55 [auto1.de] INFO: Saving data for VG29831: {'created_time': 1774694275.877066, 'last_price_update_time': 1774694275.877075, 'auction_closing_time': 1774883862.0}
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG29831') HTTP/1.1" 204 0
2026-03-28 10:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:02 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 9631 | hits on page: 40
2026-03-28 10:38:02 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-28 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-28 10:38:02 [auto1.de] INFO: Scrape type for HS42053: 0
2026-03-28 10:38:02 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-28 10:38:02 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-28 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY14416%27 HTTP/1.1" 200 None
2026-03-28 10:38:02 [auto1.de] INFO: Scrape type for PY14416: 1
2026-03-28 10:38:02 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-28 10:38:02 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-28 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM10226%27 HTTP/1.1" 200 None
2026-03-28 10:38:02 [auto1.de] INFO: Scrape type for DM10226: 1
2026-03-28 10:38:02 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-28 10:38:02 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-28 10:38:02 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-28 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE69038%27 HTTP/1.1" 200 None
2026-03-28 10:38:02 [auto1.de] INFO: Scrape type for EE69038: 1
2026-03-28 10:38:02 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA12194%27 HTTP/1.1" 200 None
2026-03-28 10:38:03 [auto1.de] INFO: Scrape type for PA12194: 1
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13405%27 HTTP/1.1" 200 None
2026-03-28 10:38:03 [auto1.de] INFO: Scrape type for HZ13405: 1
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05124%27 HTTP/1.1" 200 None
2026-03-28 10:38:03 [auto1.de] INFO: Scrape type for LU05124: 2
2026-03-28 10:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124
2026-03-28 10:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3afa6242-ac63-57f4-8d95-e67435e84324 with scrape type 2
2026-03-28 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3afa6242-ac63-57f4-8d95-e67435e84324 with scrape type 2
2026-03-28 10:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3afa6242-ac63-57f4-8d95-e67435e84324, identifier: LU05124
2026-03-28 10:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124
2026-03-28 10:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124
2026-03-28 10:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3afa6242-ac63-57f4-8d95-e67435e84324 with identifier: LU05124 to the API
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:54:02Z',
 'fuel_type': 'diesel',
 'id': '3afa6242-ac63-57f4-8d95-e67435e84324',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU05124',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 187871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-28',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2013}
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05124%27 HTTP/1.1" 200 None
2026-03-28 10:38:03 [auto1.de] INFO: Saving data for LU05124: {'auction_closing_time': 1774886042.0, 'created_time': 1774350682.46448, 'last_price_update_time': 1774694283.469515}
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU05124') HTTP/1.1" 204 0
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50371%27 HTTP/1.1" 200 None
2026-03-28 10:38:03 [auto1.de] INFO: Scrape type for TJ50371: 1
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-28 10:38:03 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA26532%27 HTTP/1.1" 200 None
2026-03-28 10:38:03 [auto1.de] INFO: Scrape type for PA26532: 2
2026-03-28 10:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532
2026-03-28 10:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with scrape type 2
2026-03-28 10:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with scrape type 2
2026-03-28 10:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71, identifier: PA26532
2026-03-28 10:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532
2026-03-28 10:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532
2026-03-28 10:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 962d0dc1-404c-52b5-9ff2-4cbdfd71cd71 with identifier: PA26532 to the API
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-30T15:49:21Z',
 'fuel_type': 'hybrid',
 'id': '962d0dc1-404c-52b5-9ff2-4cbdfd71cd71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA26532',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 48503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 2.4 Plug-in Hybrid Plus Select Black 4WD',
 'transmission': 'automatic',
 'trim': 'Plus Select Black 4WD',
 'year': 2022}
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA26532%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Saving data for PA26532: {'auction_closing_time': 1774885761.0, 'created_time': 1774350591.579727, 'last_price_update_time': 1774694284.079022}
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA26532') HTTP/1.1" 204 0
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY89611%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Scrape type for CY89611: 1
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: BB69200
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB69200%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Scrape type for BB69200: 1
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV90621%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Scrape type for DV90621: 2
2026-03-28 10:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621
2026-03-28 10:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cfc6c51-3297-5da6-937a-7825f7130efd with scrape type 2
2026-03-28 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cfc6c51-3297-5da6-937a-7825f7130efd with scrape type 2
2026-03-28 10:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cfc6c51-3297-5da6-937a-7825f7130efd, identifier: DV90621
2026-03-28 10:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621
2026-03-28 10:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621
2026-03-28 10:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cfc6c51-3297-5da6-937a-7825f7130efd with identifier: DV90621 to the API
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:16Z',
 'fuel_type': 'diesel',
 'id': '0cfc6c51-3297-5da6-937a-7825f7130efd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV90621',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 330869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-22',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2010}
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV90621%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Saving data for DV90621: {'auction_closing_time': 1774885816.0, 'created_time': 1773428457.471864, 'last_price_update_time': 1774694284.626775}
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV90621') HTTP/1.1" 204 0
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG97842%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Scrape type for AG97842: 1
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: DM85467
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM85467%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Scrape type for DM85467: 1
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA95104%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Scrape type for LA95104: 1
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44847%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Scrape type for LX44847: 1
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-28 10:38:04 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-28 10:38:04 [auto1.de] INFO: Scrape type for GG20866: 2
2026-03-28 10:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866
2026-03-28 10:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 390eeb7e-0948-53dc-b8eb-5e019d019e36 with scrape type 2
2026-03-28 10:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 390eeb7e-0948-53dc-b8eb-5e019d019e36 with scrape type 2
2026-03-28 10:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 390eeb7e-0948-53dc-b8eb-5e019d019e36, identifier: GG20866
2026-03-28 10:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866
2026-03-28 10:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866
2026-03-28 10:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 390eeb7e-0948-53dc-b8eb-5e019d019e36 with identifier: GG20866 to the API
2026-03-28 10:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:59:27Z',
 'fuel_type': 'petrol',
 'id': '390eeb7e-0948-53dc-b8eb-5e019d019e36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG20866',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 160581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-18',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-28 10:38:05 [auto1.de] INFO: Saving data for GG20866: {'auction_closing_time': 1774886367.0, 'created_time': 1773429035.282637, 'last_price_update_time': 1774694285.231532}
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG20866') HTTP/1.1" 204 0
2026-03-28 10:38:05 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-28 10:38:05 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-28 10:38:05 [auto1.de] INFO: Scrape type for WY65265: 2
2026-03-28 10:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265
2026-03-28 10:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13725041-f5f9-5e70-b087-3e2c0b642cc2 with scrape type 2
2026-03-28 10:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13725041-f5f9-5e70-b087-3e2c0b642cc2 with scrape type 2
2026-03-28 10:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13725041-f5f9-5e70-b087-3e2c0b642cc2, identifier: WY65265
2026-03-28 10:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265
2026-03-28 10:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265
2026-03-28 10:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13725041-f5f9-5e70-b087-3e2c0b642cc2 with identifier: WY65265 to the API
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:24:03Z',
 'fuel_type': 'diesel',
 'id': '13725041-f5f9-5e70-b087-3e2c0b642cc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY65265',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 227748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-28 10:38:06 [auto1.de] INFO: Saving data for WY65265: {'auction_closing_time': 1774884243.0, 'created_time': 1773427397.877473, 'last_price_update_time': 1774694286.131792}
2026-03-28 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY65265') HTTP/1.1" 204 0
2026-03-28 10:38:06 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-28 10:38:06 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-28 10:38:06 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-28 10:38:06 [scrapy.extensions.logstats] INFO: Crawled 79 pages (at 8 pages/min), scraped 64 items (at 11 items/min)
2026-03-28 10:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-28 10:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA97993/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WW38185> (referer: https://www.auto1.com/v1/car-details-view/WW38185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185
2026-03-28 10:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e4fc3a-031c-54c8-a55c-ad86b83df945 with scrape type 1
2026-03-28 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item c5e4fc3a-031c-54c8-a55c-ad86b83df945
2026-03-28 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_cf7af795839294efc5bd57bce99eb815.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_cf7af795839294efc5bd57bce99eb815.jpg not downloaded yet
2026-03-28 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_af6ad89ecd15c40b4e138c991c63b4d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_af6ad89ecd15c40b4e138c991c63b4d8.jpg not downloaded yet
2026-03-28 10:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_d95ba3b9ed8dba2ee8da637d42e74d7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_d95ba3b9ed8dba2ee8da637d42e74d7b.jpg not downloaded yet
2026-03-28 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_8cfee47d7d7db0596db611061f0237f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_8cfee47d7d7db0596db611061f0237f4.jpg not downloaded yet
2026-03-28 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_79ff43d5b0fa301ecac71d597a67eb8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_79ff43d5b0fa301ecac71d597a67eb8d.jpg not downloaded yet
2026-03-28 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_af1e7817dc794bb5c8bd658b556a4c4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_af1e7817dc794bb5c8bd658b556a4c4f.jpg not downloaded yet
2026-03-28 10:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB01809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_af1e7817dc794bb5c8bd658b556a4c4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_79ff43d5b0fa301ecac71d597a67eb8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad86d0>
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_af1e7817dc794bb5c8bd658b556a4c4f.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_af1e7817dc794bb5c8bd658b556a4c4f.jpg saved to cache
2026-03-28 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5e4fc3a-031c-54c8-a55c-ad86b83df945
2026-03-28 10:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_8cfee47d7d7db0596db611061f0237f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeb22d0>
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_79ff43d5b0fa301ecac71d597a67eb8d.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_79ff43d5b0fa301ecac71d597a67eb8d.jpg saved to cache
2026-03-28 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5e4fc3a-031c-54c8-a55c-ad86b83df945
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb9650>
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_8cfee47d7d7db0596db611061f0237f4.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_8cfee47d7d7db0596db611061f0237f4.jpg saved to cache
2026-03-28 10:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5e4fc3a-031c-54c8-a55c-ad86b83df945
2026-03-28 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UB45344> (referer: https://www.auto1.com/v1/car-details-view/UB45344/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VJ45584> (referer: https://www.auto1.com/v1/car-details-view/VJ45584/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344
2026-03-28 10:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9796d0-696a-55e5-92f4-c02db7e684e3 with scrape type 1
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2a9796d0-696a-55e5-92f4-c02db7e684e3
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_aa2e78aa667adb72dfcd452eb7db673d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_aa2e78aa667adb72dfcd452eb7db673d.jpg not downloaded yet
2026-03-28 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_af6ad89ecd15c40b4e138c991c63b4d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_826a2ff833f304bde8ae4424ee076eed.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_826a2ff833f304bde8ae4424ee076eed.jpg not downloaded yet
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_cd5c5fb934a0c3ec0b2754ac6d0491a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_cd5c5fb934a0c3ec0b2754ac6d0491a4.jpg not downloaded yet
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_a3492691a4b47cd9ca5587ef2c4d829a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_a3492691a4b47cd9ca5587ef2c4d829a.jpg not downloaded yet
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_33fec7ff6768b7e7827697a793f5ca94.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_33fec7ff6768b7e7827697a793f5ca94.jpg not downloaded yet
2026-03-28 10:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584
2026-03-28 10:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with scrape type 1
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_abc2728bf99b440179155f2ff4b9c2e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_abc2728bf99b440179155f2ff4b9c2e2.jpg not downloaded yet
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_9efc5bc9ea021110991b1f56b8d623b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_9efc5bc9ea021110991b1f56b8d623b7.jpg not downloaded yet
2026-03-28 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_d95ba3b9ed8dba2ee8da637d42e74d7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_a67124284a0dc7972948ff9f35b98b58.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_a67124284a0dc7972948ff9f35b98b58.jpg not downloaded yet
2026-03-28 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_aa2e78aa667adb72dfcd452eb7db673d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_6ca7d96d39d9d01e6170e93aea875e95.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_6ca7d96d39d9d01e6170e93aea875e95.jpg not downloaded yet
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a42490>
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_af6ad89ecd15c40b4e138c991c63b4d8.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_af6ad89ecd15c40b4e138c991c63b4d8.jpg saved to cache
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5e4fc3a-031c-54c8-a55c-ad86b83df945
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_cdb006834e431e5c06ab45836a758eec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_cdb006834e431e5c06ab45836a758eec.jpg not downloaded yet
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_975f4dc52f056e8c9ec2864b9717cd8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_975f4dc52f056e8c9ec2864b9717cd8f.jpg not downloaded yet
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe36dd0>
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_d95ba3b9ed8dba2ee8da637d42e74d7b.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_d95ba3b9ed8dba2ee8da637d42e74d7b.jpg saved to cache
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5e4fc3a-031c-54c8-a55c-ad86b83df945
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_606f0ec120a3717e603bb9fa65d024a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_606f0ec120a3717e603bb9fa65d024a1.jpg not downloaded yet
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5e310>
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_aa2e78aa667adb72dfcd452eb7db673d.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_aa2e78aa667adb72dfcd452eb7db673d.jpg saved to cache
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2a9796d0-696a-55e5-92f4-c02db7e684e3
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_ff3ace7e7fb68cbe9011b8980790fc13.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_ff3ace7e7fb68cbe9011b8980790fc13.jpg not downloaded yet
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_a14f8b7c9d6887eb739d65a11d6f9400.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_a14f8b7c9d6887eb739d65a11d6f9400.jpg not downloaded yet
2026-03-28 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_9efc5bc9ea021110991b1f56b8d623b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_80f797b1a52cb5caf03584f4da3e07ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_80f797b1a52cb5caf03584f4da3e07ea.jpg not downloaded yet
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabff6850>
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_9efc5bc9ea021110991b1f56b8d623b7.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_9efc5bc9ea021110991b1f56b8d623b7.jpg saved to cache
2026-03-28 10:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_a67124284a0dc7972948ff9f35b98b58.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_a14f8b7c9d6887eb739d65a11d6f9400.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd0d2d0>
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_a67124284a0dc7972948ff9f35b98b58.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_a67124284a0dc7972948ff9f35b98b58.jpg saved to cache
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DY33691/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdbb090>
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_a14f8b7c9d6887eb739d65a11d6f9400.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_a14f8b7c9d6887eb739d65a11d6f9400.jpg saved to cache
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_80f797b1a52cb5caf03584f4da3e07ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fd310>
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_80f797b1a52cb5caf03584f4da3e07ea.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_80f797b1a52cb5caf03584f4da3e07ea.jpg saved to cache
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_975f4dc52f056e8c9ec2864b9717cd8f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF26983/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_ff3ace7e7fb68cbe9011b8980790fc13.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5ed90>
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_975f4dc52f056e8c9ec2864b9717cd8f.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_975f4dc52f056e8c9ec2864b9717cd8f.jpg saved to cache
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_606f0ec120a3717e603bb9fa65d024a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd18c10>
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_ff3ace7e7fb68cbe9011b8980790fc13.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_ff3ace7e7fb68cbe9011b8980790fc13.jpg saved to cache
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_cdb006834e431e5c06ab45836a758eec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_6ca7d96d39d9d01e6170e93aea875e95.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef32d0>
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_606f0ec120a3717e603bb9fa65d024a1.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_606f0ec120a3717e603bb9fa65d024a1.jpg saved to cache
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb7dd0>
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_cdb006834e431e5c06ab45836a758eec.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_cdb006834e431e5c06ab45836a758eec.jpg saved to cache
2026-03-28 10:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5cdd0>
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_6ca7d96d39d9d01e6170e93aea875e95.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_6ca7d96d39d9d01e6170e93aea875e95.jpg saved to cache
2026-03-28 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_33fec7ff6768b7e7827697a793f5ca94.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_a3492691a4b47cd9ca5587ef2c4d829a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_abc2728bf99b440179155f2ff4b9c2e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd51950>
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_33fec7ff6768b7e7827697a793f5ca94.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_33fec7ff6768b7e7827697a793f5ca94.jpg saved to cache
2026-03-28 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2a9796d0-696a-55e5-92f4-c02db7e684e3
2026-03-28 10:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_826a2ff833f304bde8ae4424ee076eed.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5ef50>
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_a3492691a4b47cd9ca5587ef2c4d829a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_a3492691a4b47cd9ca5587ef2c4d829a.jpg saved to cache
2026-03-28 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2a9796d0-696a-55e5-92f4-c02db7e684e3
2026-03-28 10:38:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a0fed0>
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252F5d%252F895d151be9bf6ab0e396a42e27c585b2%252Fpa%252FVJ45584_abc2728bf99b440179155f2ff4b9c2e2.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_abc2728bf99b440179155f2ff4b9c2e2.jpg saved to cache
2026-03-28 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3
2026-03-28 10:38:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3, skipping ID generation
2026-03-28 10:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with scrape type 1
2026-03-28 10:38:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 sending to next pipeline
2026-03-28 10:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3, identifier: VJ45584
2026-03-28 10:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584
2026-03-28 10:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584
2026-03-28 10:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34e114cc-68be-5e54-af11-1d5fd7bb5bc3 with identifier: VJ45584 to the API
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_abc2728bf99b440179155f2ff4b9c2e2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:35Z',
 'fuel_type': 'petrol',
 'id': '34e114cc-68be-5e54-af11-1d5fd7bb5bc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ45584',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 137753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2935996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_abc2728bf99b440179155f2ff4b9c2e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_9efc5bc9ea021110991b1f56b8d623b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2611364,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_a67124284a0dc7972948ff9f35b98b58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_6ca7d96d39d9d01e6170e93aea875e95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86620,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_cdb006834e431e5c06ab45836a758eec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_975f4dc52f056e8c9ec2864b9717cd8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2418343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_606f0ec120a3717e603bb9fa65d024a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2667409,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_ff3ace7e7fb68cbe9011b8980790fc13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2840430,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_a14f8b7c9d6887eb739d65a11d6f9400.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34e114cc-68be-5e54-af11-1d5fd7bb5bc3/34e114cc-68be-5e54-af11-1d5fd7bb5bc3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2776027,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/5d/895d151be9bf6ab0e396a42e27c585b2/pa/VJ45584_80f797b1a52cb5caf03584f4da3e07ea.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2016}
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ45584%27 HTTP/1.1" 200 None
2026-03-28 10:38:24 [auto1.de] INFO: Saving data for VJ45584: {'created_time': 1774694304.98772, 'last_price_update_time': 1774694304.987731, 'auction_closing_time': 1774885115.0}
2026-03-28 10:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ45584') HTTP/1.1" 204 0
2026-03-28 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_cd5c5fb934a0c3ec0b2754ac6d0491a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_cf7af795839294efc5bd57bce99eb815.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe33f90>
2026-03-28 10:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_826a2ff833f304bde8ae4424ee076eed.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_826a2ff833f304bde8ae4424ee076eed.jpg saved to cache
2026-03-28 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2a9796d0-696a-55e5-92f4-c02db7e684e3
2026-03-28 10:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda70d0>
2026-03-28 10:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf1%252Fde%252Ff1de03376b06fd9ebb47720948c1232a%252Fpa%252FUB45344_cd5c5fb934a0c3ec0b2754ac6d0491a4.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_cd5c5fb934a0c3ec0b2754ac6d0491a4.jpg saved to cache
2026-03-28 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2a9796d0-696a-55e5-92f4-c02db7e684e3
2026-03-28 10:38:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2a9796d0-696a-55e5-92f4-c02db7e684e3, skipping ID generation
2026-03-28 10:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a9796d0-696a-55e5-92f4-c02db7e684e3 with scrape type 1
2026-03-28 10:38:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2a9796d0-696a-55e5-92f4-c02db7e684e3 sending to next pipeline
2026-03-28 10:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a9796d0-696a-55e5-92f4-c02db7e684e3, identifier: UB45344
2026-03-28 10:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344
2026-03-28 10:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344
2026-03-28 10:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a9796d0-696a-55e5-92f4-c02db7e684e3 with identifier: UB45344 to the API
2026-03-28 10:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_cd5c5fb934a0c3ec0b2754ac6d0491a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:54Z',
 'fuel_type': 'petrol',
 'id': '2a9796d0-696a-55e5-92f4-c02db7e684e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB45344',
 'listing': 'auction',
 'location': 'DE, Paderborn',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 205575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_aa2e78aa667adb72dfcd452eb7db673d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_826a2ff833f304bde8ae4424ee076eed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_cd5c5fb934a0c3ec0b2754ac6d0491a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_a3492691a4b47cd9ca5587ef2c4d829a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a9796d0-696a-55e5-92f4-c02db7e684e3/2a9796d0-696a-55e5-92f4-c02db7e684e3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 144815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf1/de/f1de03376b06fd9ebb47720948c1232a/pa/UB45344_33fec7ff6768b7e7827697a793f5ca94.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45344%27 HTTP/1.1" 200 None
2026-03-28 10:38:26 [auto1.de] INFO: Saving data for UB45344: {'created_time': 1774694306.941891, 'last_price_update_time': 1774694306.941903, 'auction_closing_time': 1774885194.0}
2026-03-28 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB45344') HTTP/1.1" 204 0
2026-03-28 10:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeb2910>
2026-03-28 10:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fd1%252F0bd161a13a9474bd71a39a1f1530532c%252Fpa%252FWW38185_cf7af795839294efc5bd57bce99eb815.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_cf7af795839294efc5bd57bce99eb815.jpg saved to cache
2026-03-28 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5e4fc3a-031c-54c8-a55c-ad86b83df945
2026-03-28 10:38:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5e4fc3a-031c-54c8-a55c-ad86b83df945, skipping ID generation
2026-03-28 10:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5e4fc3a-031c-54c8-a55c-ad86b83df945 with scrape type 1
2026-03-28 10:38:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5e4fc3a-031c-54c8-a55c-ad86b83df945 sending to next pipeline
2026-03-28 10:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5e4fc3a-031c-54c8-a55c-ad86b83df945, identifier: WW38185
2026-03-28 10:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185
2026-03-28 10:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185
2026-03-28 10:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5e4fc3a-031c-54c8-a55c-ad86b83df945 with identifier: WW38185 to the API
2026-03-28 10:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_cf7af795839294efc5bd57bce99eb815.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:19:05Z',
 'fuel_type': 'diesel',
 'id': 'c5e4fc3a-031c-54c8-a55c-ad86b83df945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW38185',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 303451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_cf7af795839294efc5bd57bce99eb815.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_af6ad89ecd15c40b4e138c991c63b4d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_d95ba3b9ed8dba2ee8da637d42e74d7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_8cfee47d7d7db0596db611061f0237f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_79ff43d5b0fa301ecac71d597a67eb8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5e4fc3a-031c-54c8-a55c-ad86b83df945/c5e4fc3a-031c-54c8-a55c-ad86b83df945_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/d1/0bd161a13a9474bd71a39a1f1530532c/pa/WW38185_af1e7817dc794bb5c8bd658b556a4c4f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2010}
2026-03-28 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW38185%27 HTTP/1.1" 200 None
2026-03-28 10:38:28 [auto1.de] INFO: Saving data for WW38185: {'created_time': 1774694308.498407, 'last_price_update_time': 1774694308.498417, 'auction_closing_time': 1774883945.0}
2026-03-28 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW38185') HTTP/1.1" 204 0
2026-03-28 10:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EH91582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV43592> (referer: https://www.auto1.com/v1/car-details-view/NV43592/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592
2026-03-28 10:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with scrape type 1
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_5080ad796d0fbc49e083fbf007eb27ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_5080ad796d0fbc49e083fbf007eb27ad.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_80af19641305669fed0d23235e819620.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_80af19641305669fed0d23235e819620.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_cb9884c6c1e49972563e33b3c1dd7db8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_cb9884c6c1e49972563e33b3c1dd7db8.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_1bb6a1b27f2cb51e5614a752041864c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_1bb6a1b27f2cb51e5614a752041864c5.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_1568e13bff9af8cf2d8ee03fb072aae3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_1568e13bff9af8cf2d8ee03fb072aae3.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_b0933abcc1a618ffda6109e71b899ee8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_b0933abcc1a618ffda6109e71b899ee8.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_a38c7625c4501bbda5e9a04bee81ba78.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_a38c7625c4501bbda5e9a04bee81ba78.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_896032963d272c5deb121edee0f0d549.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_896032963d272c5deb121edee0f0d549.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_190b4c1a10ad86c865e5165cc8c12e68.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_190b4c1a10ad86c865e5165cc8c12e68.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_8183193c1d214de122e43f500b730395.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_8183193c1d214de122e43f500b730395.jpg not downloaded yet
2026-03-28 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZR61272> (referer: https://www.auto1.com/v1/car-details-view/ZR61272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272
2026-03-28 10:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcb4f497-9e25-55a0-b724-bb623217da7d with scrape type 1
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_b8b1cf820543265bc19484a4e6ffd872.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_b8b1cf820543265bc19484a4e6ffd872.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_10cab29d7783adf964561dad3035af6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_10cab29d7783adf964561dad3035af6d.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_998ab703c93514f5234e8a51c6294b3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_998ab703c93514f5234e8a51c6294b3f.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_3e3212693254993f5cd856d9f06969cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_3e3212693254993f5cd856d9f06969cf.jpg not downloaded yet
2026-03-28 10:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_8183193c1d214de122e43f500b730395.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_fc18791241634eddd517c6e50da05830.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_fc18791241634eddd517c6e50da05830.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_40cf37cae9c81cb7b62fe1de28d43bcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_40cf37cae9c81cb7b62fe1de28d43bcc.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_b62a1a554f32f87cba0a33031e3ecbf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_b62a1a554f32f87cba0a33031e3ecbf6.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_e77498049135198e168a0cfa943ba291.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_e77498049135198e168a0cfa943ba291.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_9230c8e63af699a5470c4a45abdccb44.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_9230c8e63af699a5470c4a45abdccb44.jpg not downloaded yet
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_7192e6d071a2a12f22ed71c3c11f5133.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_7192e6d071a2a12f22ed71c3c11f5133.jpg not downloaded yet
2026-03-28 10:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd89850>
2026-03-28 10:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_8183193c1d214de122e43f500b730395.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_8183193c1d214de122e43f500b730395.jpg saved to cache
2026-03-28 10:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_3e3212693254993f5cd856d9f06969cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fc050>
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_3e3212693254993f5cd856d9f06969cf.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_3e3212693254993f5cd856d9f06969cf.jpg saved to cache
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_7192e6d071a2a12f22ed71c3c11f5133.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe33610>
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_7192e6d071a2a12f22ed71c3c11f5133.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_7192e6d071a2a12f22ed71c3c11f5133.jpg saved to cache
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_9230c8e63af699a5470c4a45abdccb44.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX44847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88b99d0>
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_9230c8e63af699a5470c4a45abdccb44.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_9230c8e63af699a5470c4a45abdccb44.jpg saved to cache
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_e77498049135198e168a0cfa943ba291.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_b62a1a554f32f87cba0a33031e3ecbf6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA97993> (referer: https://www.auto1.com/v1/car-details-view/DA97993/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a42250>
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_e77498049135198e168a0cfa943ba291.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_e77498049135198e168a0cfa943ba291.jpg saved to cache
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:30 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.065(s), this was the 1st time calling it.
2026-03-28 10:38:30 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.480452983824634 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:38:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a71950>
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_b62a1a554f32f87cba0a33031e3ecbf6.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_b62a1a554f32f87cba0a33031e3ecbf6.jpg saved to cache
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993
2026-03-28 10:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52995c24-6e8c-547b-9aa5-966c7278154e with scrape type 1
2026-03-28 10:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_1b03366830a275b5cb15aca6ae846223.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_1b03366830a275b5cb15aca6ae846223.jpg not downloaded yet
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_0182cd712c11f54e9d2d136a420cf410.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_0182cd712c11f54e9d2d136a420cf410.jpg not downloaded yet
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_61179ef2c0bb9046e63b30ff66f9ec8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_61179ef2c0bb9046e63b30ff66f9ec8a.jpg not downloaded yet
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_5e801cd864b76c80306169ea4ce39882.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_5e801cd864b76c80306169ea4ce39882.jpg not downloaded yet
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_b18a7cbac8ea86f3e4ccd918a11e16c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_b18a7cbac8ea86f3e4ccd918a11e16c2.jpg not downloaded yet
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_d627504b88701fec82009deb0c859478.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_d627504b88701fec82009deb0c859478.jpg not downloaded yet
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_e9c95b53a6bf8831aa84fcef73ee54b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e9c95b53a6bf8831aa84fcef73ee54b1.jpg not downloaded yet
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_e9bc729e402788cbbd5c69c14e7cab95.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e9bc729e402788cbbd5c69c14e7cab95.jpg not downloaded yet
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_e6ae303ba917e03d64ada5ab8f01ccd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e6ae303ba917e03d64ada5ab8f01ccd5.jpg not downloaded yet
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_d4193adc9ac9a288657a02a4e926c254.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_d4193adc9ac9a288657a02a4e926c254.jpg not downloaded yet
2026-03-28 10:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_fc18791241634eddd517c6e50da05830.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_40cf37cae9c81cb7b62fe1de28d43bcc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe99c10>
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_fc18791241634eddd517c6e50da05830.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_fc18791241634eddd517c6e50da05830.jpg saved to cache
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_d4193adc9ac9a288657a02a4e926c254.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a42650>
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_40cf37cae9c81cb7b62fe1de28d43bcc.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_40cf37cae9c81cb7b62fe1de28d43bcc.jpg saved to cache
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e6ae303ba917e03d64ada5ab8f01ccd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ca850>
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_d4193adc9ac9a288657a02a4e926c254.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_d4193adc9ac9a288657a02a4e926c254.jpg saved to cache
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a41b10>
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_e6ae303ba917e03d64ada5ab8f01ccd5.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e6ae303ba917e03d64ada5ab8f01ccd5.jpg saved to cache
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e9bc729e402788cbbd5c69c14e7cab95.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e9c95b53a6bf8831aa84fcef73ee54b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB01809> (referer: https://www.auto1.com/v1/car-details-view/PB01809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88b95d0>
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_e9bc729e402788cbbd5c69c14e7cab95.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e9bc729e402788cbbd5c69c14e7cab95.jpg saved to cache
2026-03-28 10:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf68c10>
2026-03-28 10:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_e9c95b53a6bf8831aa84fcef73ee54b1.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e9c95b53a6bf8831aa84fcef73ee54b1.jpg saved to cache
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DY33691> (referer: https://www.auto1.com/v1/car-details-view/DY33691/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809
2026-03-28 10:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with scrape type 1
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_0d4f4704fa31bbf5167f2d960c459524.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_0d4f4704fa31bbf5167f2d960c459524.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_342f58c129b992f924e0e6716683057a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_342f58c129b992f924e0e6716683057a.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_2746953faab23cb2defb48350fcd6b93.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_2746953faab23cb2defb48350fcd6b93.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_eaf6160bd9c028e6e4aef54ea6e584c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_eaf6160bd9c028e6e4aef54ea6e584c0.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_4915ab3cd3db9ae26a1aee4cd9c0d2a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_4915ab3cd3db9ae26a1aee4cd9c0d2a4.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_5b8339a701be24bccb474d484a5cdd21.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_5b8339a701be24bccb474d484a5cdd21.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_1441cb65f39890f9655a69ed5b4d0bb4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_1441cb65f39890f9655a69ed5b4d0bb4.jpg not downloaded yet
2026-03-28 10:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691
2026-03-28 10:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdca34c6-973f-594f-951f-40ea40b01917 with scrape type 1
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_da8c7211aa11a169cfa748ef62286cdb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_da8c7211aa11a169cfa748ef62286cdb.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_fb975f0989f6e02515300d6cf06faa1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_fb975f0989f6e02515300d6cf06faa1b.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_de7bc0948ce0c5d9f1cc5bc4bbd43652.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_de7bc0948ce0c5d9f1cc5bc4bbd43652.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_7a5c83f1a5fcebdf42a9dd1cf404eaab.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_7a5c83f1a5fcebdf42a9dd1cf404eaab.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_59714dad5b862464d281514680877527.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_59714dad5b862464d281514680877527.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_cac8bca57f98bcac4b5aa3c1a7d8bc5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_cac8bca57f98bcac4b5aa3c1a7d8bc5f.jpg not downloaded yet
2026-03-28 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_61179ef2c0bb9046e63b30ff66f9ec8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_f604f1840631321ea7c7b7e08539ea23.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_f604f1840631321ea7c7b7e08539ea23.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_102199a355e3aef389477887512fb4ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_102199a355e3aef389477887512fb4ac.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_f972ff4b39b5b07bd162cab6c938bb2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_f972ff4b39b5b07bd162cab6c938bb2e.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_6350a978d4b8d1111d0b8d9fd95c8a5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_6350a978d4b8d1111d0b8d9fd95c8a5b.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_5d0795ce756c5a1a11be9e8bc61756e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_5d0795ce756c5a1a11be9e8bc61756e1.jpg not downloaded yet
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_81ebd74704560d13040a0d778afb51a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_81ebd74704560d13040a0d778afb51a6.jpg not downloaded yet
2026-03-28 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_d627504b88701fec82009deb0c859478.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_71c7cd2f80ae29d79d7839a072611cf7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_71c7cd2f80ae29d79d7839a072611cf7.jpg not downloaded yet
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8bd10>
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_61179ef2c0bb9046e63b30ff66f9ec8a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_61179ef2c0bb9046e63b30ff66f9ec8a.jpg saved to cache
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_59714dad5b862464d281514680877527.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_5e801cd864b76c80306169ea4ce39882.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_b18a7cbac8ea86f3e4ccd918a11e16c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf97b10>
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_d627504b88701fec82009deb0c859478.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_d627504b88701fec82009deb0c859478.jpg saved to cache
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_81ebd74704560d13040a0d778afb51a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5fe50>
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_59714dad5b862464d281514680877527.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_59714dad5b862464d281514680877527.jpg saved to cache
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba79c210>
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_5e801cd864b76c80306169ea4ce39882.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_5e801cd864b76c80306169ea4ce39882.jpg saved to cache
2026-03-28 10:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe28990>
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_b18a7cbac8ea86f3e4ccd918a11e16c2.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_b18a7cbac8ea86f3e4ccd918a11e16c2.jpg saved to cache
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LA95104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd46590>
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_81ebd74704560d13040a0d778afb51a6.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_81ebd74704560d13040a0d778afb51a6.jpg saved to cache
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_71c7cd2f80ae29d79d7839a072611cf7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF26983> (referer: https://www.auto1.com/v1/car-details-view/WF26983/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf73dd0>
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_71c7cd2f80ae29d79d7839a072611cf7.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_71c7cd2f80ae29d79d7839a072611cf7.jpg saved to cache
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_6350a978d4b8d1111d0b8d9fd95c8a5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_102199a355e3aef389477887512fb4ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983
2026-03-28 10:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with scrape type 1
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_cee86e156097cb55df5e85789d117724.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_cee86e156097cb55df5e85789d117724.jpg not downloaded yet
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_af37ba636bf2e6b35fd1e68b511d70f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_af37ba636bf2e6b35fd1e68b511d70f2.jpg not downloaded yet
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_01b383566be6a1b2d879642bbadff9c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_01b383566be6a1b2d879642bbadff9c8.jpg not downloaded yet
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_1def6b90c3acb3b072a0981af39b8acf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_1def6b90c3acb3b072a0981af39b8acf.jpg not downloaded yet
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_af3fc7ba1200004bd7fcec12b7ac3944.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_af3fc7ba1200004bd7fcec12b7ac3944.jpg not downloaded yet
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_86928d25730cb8032abf1c28091948f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_86928d25730cb8032abf1c28091948f1.jpg not downloaded yet
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd50110>
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_6350a978d4b8d1111d0b8d9fd95c8a5b.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_6350a978d4b8d1111d0b8d9fd95c8a5b.jpg saved to cache
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_2575242181473cd093df00dc602abeef.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_2575242181473cd093df00dc602abeef.jpg not downloaded yet
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88c9610>
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_102199a355e3aef389477887512fb4ac.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_102199a355e3aef389477887512fb4ac.jpg saved to cache
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_7a5c83f1a5fcebdf42a9dd1cf404eaab.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_f02491a8ac7ab1d274d515a9d3f2a7c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_f02491a8ac7ab1d274d515a9d3f2a7c9.jpg not downloaded yet
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_3b2144766d988de62efa55ad3571acf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_3b2144766d988de62efa55ad3571acf3.jpg not downloaded yet
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_00c5d085d2e1085515e7c74c0f324248.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_00c5d085d2e1085515e7c74c0f324248.jpg not downloaded yet
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_cac8bca57f98bcac4b5aa3c1a7d8bc5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_f604f1840631321ea7c7b7e08539ea23.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_f972ff4b39b5b07bd162cab6c938bb2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_5d0795ce756c5a1a11be9e8bc61756e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd88810>
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_7a5c83f1a5fcebdf42a9dd1cf404eaab.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_7a5c83f1a5fcebdf42a9dd1cf404eaab.jpg saved to cache
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_00c5d085d2e1085515e7c74c0f324248.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_2575242181473cd093df00dc602abeef.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a0c110>
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_cac8bca57f98bcac4b5aa3c1a7d8bc5f.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_cac8bca57f98bcac4b5aa3c1a7d8bc5f.jpg saved to cache
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f8c50>
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_f604f1840631321ea7c7b7e08539ea23.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_f604f1840631321ea7c7b7e08539ea23.jpg saved to cache
2026-03-28 10:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf948d0>
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_f972ff4b39b5b07bd162cab6c938bb2e.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_f972ff4b39b5b07bd162cab6c938bb2e.jpg saved to cache
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed7d90>
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_5d0795ce756c5a1a11be9e8bc61756e1.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_5d0795ce756c5a1a11be9e8bc61756e1.jpg saved to cache
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf97510>
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_00c5d085d2e1085515e7c74c0f324248.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_00c5d085d2e1085515e7c74c0f324248.jpg saved to cache
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad2290>
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_2575242181473cd093df00dc602abeef.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_2575242181473cd093df00dc602abeef.jpg saved to cache
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_f02491a8ac7ab1d274d515a9d3f2a7c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_3b2144766d988de62efa55ad3571acf3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_af3fc7ba1200004bd7fcec12b7ac3944.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_1def6b90c3acb3b072a0981af39b8acf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_af37ba636bf2e6b35fd1e68b511d70f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd53b10>
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_f02491a8ac7ab1d274d515a9d3f2a7c9.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_f02491a8ac7ab1d274d515a9d3f2a7c9.jpg saved to cache
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe07d10>
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_3b2144766d988de62efa55ad3571acf3.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_3b2144766d988de62efa55ad3571acf3.jpg saved to cache
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ba850>
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_af3fc7ba1200004bd7fcec12b7ac3944.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_af3fc7ba1200004bd7fcec12b7ac3944.jpg saved to cache
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc0a010>
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_1def6b90c3acb3b072a0981af39b8acf.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_1def6b90c3acb3b072a0981af39b8acf.jpg saved to cache
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5d350>
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_af37ba636bf2e6b35fd1e68b511d70f2.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_af37ba636bf2e6b35fd1e68b511d70f2.jpg saved to cache
2026-03-28 10:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_86928d25730cb8032abf1c28091948f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_01b383566be6a1b2d879642bbadff9c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_cee86e156097cb55df5e85789d117724.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_da8c7211aa11a169cfa748ef62286cdb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd18fd0>
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_86928d25730cb8032abf1c28091948f1.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_86928d25730cb8032abf1c28091948f1.jpg saved to cache
2026-03-28 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_de7bc0948ce0c5d9f1cc5bc4bbd43652.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_fb975f0989f6e02515300d6cf06faa1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc3b10>
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_01b383566be6a1b2d879642bbadff9c8.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_01b383566be6a1b2d879642bbadff9c8.jpg saved to cache
2026-03-28 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf75fd0>
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8c%252F64%252F8c64b0d435c8ef2a012c3d25c2fdaf25%252Fpa%252FWF26983_cee86e156097cb55df5e85789d117724.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_cee86e156097cb55df5e85789d117724.jpg saved to cache
2026-03-28 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5
2026-03-28 10:38:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5, skipping ID generation
2026-03-28 10:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with scrape type 1
2026-03-28 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 sending to next pipeline
2026-03-28 10:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5, identifier: WF26983
2026-03-28 10:38:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed50d0>
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_da8c7211aa11a169cfa748ef62286cdb.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_da8c7211aa11a169cfa748ef62286cdb.jpg saved to cache
2026-03-28 10:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983
2026-03-28 10:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983
2026-03-28 10:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5 with identifier: WF26983 to the API
2026-03-28 10:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_cee86e156097cb55df5e85789d117724.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:21:05Z',
 'fuel_type': 'diesel',
 'id': '7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF26983',
 'listing': 'auction',
 'location': 'DE, Regensburg',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 164214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2918459,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_cee86e156097cb55df5e85789d117724.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_af37ba636bf2e6b35fd1e68b511d70f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2690184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_01b383566be6a1b2d879642bbadff9c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492313,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_1def6b90c3acb3b072a0981af39b8acf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2943224,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_af3fc7ba1200004bd7fcec12b7ac3944.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2832718,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_86928d25730cb8032abf1c28091948f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632049,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_2575242181473cd093df00dc602abeef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_f02491a8ac7ab1d274d515a9d3f2a7c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_3b2144766d988de62efa55ad3571acf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5/7ba3e6a1-9b59-5694-97e2-e08ea0ddcba5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8c/64/8c64b0d435c8ef2a012c3d25c2fdaf25/pa/WF26983_00c5d085d2e1085515e7c74c0f324248.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF26983%27 HTTP/1.1" 200 None
2026-03-28 10:38:36 [auto1.de] INFO: Saving data for WF26983: {'created_time': 1774694316.954325, 'last_price_update_time': 1774694316.954335, 'auction_closing_time': 1774884065.0}
2026-03-28 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF26983') HTTP/1.1" 204 0
2026-03-28 10:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM85467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fefd0>
2026-03-28 10:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fec%252Fcfec158d197fed367300ef615da58c4b%252Fpa%252FDY33691_de7bc0948ce0c5d9f1cc5bc4bbd43652.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_de7bc0948ce0c5d9f1cc5bc4bbd43652.jpg saved to cache
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bdca34c6-973f-594f-951f-40ea40b01917
2026-03-28 10:38:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bdca34c6-973f-594f-951f-40ea40b01917, skipping ID generation
2026-03-28 10:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdca34c6-973f-594f-951f-40ea40b01917 with scrape type 1
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bdca34c6-973f-594f-951f-40ea40b01917 sending to next pipeline
2026-03-28 10:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdca34c6-973f-594f-951f-40ea40b01917, identifier: DY33691
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd94350>
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_fb975f0989f6e02515300d6cf06faa1b.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_fb975f0989f6e02515300d6cf06faa1b.jpg saved to cache
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691
2026-03-28 10:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691
2026-03-28 10:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdca34c6-973f-594f-951f-40ea40b01917 with identifier: DY33691 to the API
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_de7bc0948ce0c5d9f1cc5bc4bbd43652.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 220,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 285,
 'expiration_date': '2026-03-30T15:14:20Z',
 'fuel_type': 'diesel',
 'id': 'bdca34c6-973f-594f-951f-40ea40b01917',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY33691',
 'listing': 'auction',
 'location': 'DE, Krefeld',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 263215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3084849,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_da8c7211aa11a169cfa748ef62286cdb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_de7bc0948ce0c5d9f1cc5bc4bbd43652.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_59714dad5b862464d281514680877527.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3005207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_f604f1840631321ea7c7b7e08539ea23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_102199a355e3aef389477887512fb4ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3135769,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_f972ff4b39b5b07bd162cab6c938bb2e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_6350a978d4b8d1111d0b8d9fd95c8a5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3206553,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_5d0795ce756c5a1a11be9e8bc61756e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_81ebd74704560d13040a0d778afb51a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bdca34c6-973f-594f-951f-40ea40b01917/bdca34c6-973f-594f-951f-40ea40b01917_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3320257,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/ec/cfec158d197fed367300ef615da58c4b/pa/DY33691_71c7cd2f80ae29d79d7839a072611cf7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 35d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-28 10:38:37 [auto1.de] INFO: Saving data for DY33691: {'created_time': 1774694317.574954, 'last_price_update_time': 1774694317.574966, 'auction_closing_time': 1774883660.0}
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY33691') HTTP/1.1" 204 0
2026-03-28 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_eaf6160bd9c028e6e4aef54ea6e584c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_2746953faab23cb2defb48350fcd6b93.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_4915ab3cd3db9ae26a1aee4cd9c0d2a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_5b8339a701be24bccb474d484a5cdd21.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_1441cb65f39890f9655a69ed5b4d0bb4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_0d4f4704fa31bbf5167f2d960c459524.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a62b90>
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_eaf6160bd9c028e6e4aef54ea6e584c0.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_eaf6160bd9c028e6e4aef54ea6e584c0.jpg saved to cache
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdd7d0>
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_2746953faab23cb2defb48350fcd6b93.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_2746953faab23cb2defb48350fcd6b93.jpg saved to cache
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a0e590>
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_4915ab3cd3db9ae26a1aee4cd9c0d2a4.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_4915ab3cd3db9ae26a1aee4cd9c0d2a4.jpg saved to cache
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad61d0>
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_5b8339a701be24bccb474d484a5cdd21.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_5b8339a701be24bccb474d484a5cdd21.jpg saved to cache
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed2d50>
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_1441cb65f39890f9655a69ed5b4d0bb4.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_1441cb65f39890f9655a69ed5b4d0bb4.jpg saved to cache
2026-03-28 10:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_0182cd712c11f54e9d2d136a420cf410.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_342f58c129b992f924e0e6716683057a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fc790>
2026-03-28 10:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_0d4f4704fa31bbf5167f2d960c459524.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_0d4f4704fa31bbf5167f2d960c459524.jpg saved to cache
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_1b03366830a275b5cb15aca6ae846223.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_998ab703c93514f5234e8a51c6294b3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_b8b1cf820543265bc19484a4e6ffd872.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_10cab29d7783adf964561dad3035af6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a43850>
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_0182cd712c11f54e9d2d136a420cf410.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_0182cd712c11f54e9d2d136a420cf410.jpg saved to cache
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fd0d0>
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F46%252F4f46b9174557b8b8f16e2ebb6efbf8f8%252Fpa%252FPB01809_342f58c129b992f924e0e6716683057a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_342f58c129b992f924e0e6716683057a.jpg saved to cache
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907
2026-03-28 10:38:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907, skipping ID generation
2026-03-28 10:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with scrape type 1
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 sending to next pipeline
2026-03-28 10:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907, identifier: PB01809
2026-03-28 10:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809
2026-03-28 10:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809
2026-03-28 10:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c9efe3b-66b6-5e56-9f8d-49eec0c9e907 with identifier: PB01809 to the API
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_342f58c129b992f924e0e6716683057a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:03Z',
 'fuel_type': 'petrol',
 'id': '7c9efe3b-66b6-5e56-9f8d-49eec0c9e907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB01809',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 57474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_0d4f4704fa31bbf5167f2d960c459524.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_342f58c129b992f924e0e6716683057a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_2746953faab23cb2defb48350fcd6b93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_eaf6160bd9c028e6e4aef54ea6e584c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_4915ab3cd3db9ae26a1aee4cd9c0d2a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_5b8339a701be24bccb474d484a5cdd21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_1441cb65f39890f9655a69ed5b4d0bb4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_fb975f0989f6e02515300d6cf06faa1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_7a5c83f1a5fcebdf42a9dd1cf404eaab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c9efe3b-66b6-5e56-9f8d-49eec0c9e907/7c9efe3b-66b6-5e56-9f8d-49eec0c9e907_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/46/4f46b9174557b8b8f16e2ebb6efbf8f8/pa/PB01809_cac8bca57f98bcac4b5aa3c1a7d8bc5f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat 500X 1.6 Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2016}
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB01809%27 HTTP/1.1" 200 None
2026-03-28 10:38:38 [auto1.de] INFO: Saving data for PB01809: {'created_time': 1774694318.668045, 'last_price_update_time': 1774694318.668056, 'auction_closing_time': 1774884063.0}
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB01809') HTTP/1.1" 204 0
2026-03-28 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_190b4c1a10ad86c865e5165cc8c12e68.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_896032963d272c5deb121edee0f0d549.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabec84d0>
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F21%252Fc621287ac7f03ec93381749dbe61022c%252Fpa%252FDA97993_1b03366830a275b5cb15aca6ae846223.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_1b03366830a275b5cb15aca6ae846223.jpg saved to cache
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52995c24-6e8c-547b-9aa5-966c7278154e
2026-03-28 10:38:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52995c24-6e8c-547b-9aa5-966c7278154e, skipping ID generation
2026-03-28 10:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52995c24-6e8c-547b-9aa5-966c7278154e with scrape type 1
2026-03-28 10:38:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52995c24-6e8c-547b-9aa5-966c7278154e sending to next pipeline
2026-03-28 10:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52995c24-6e8c-547b-9aa5-966c7278154e, identifier: DA97993
2026-03-28 10:38:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef0f90>
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_998ab703c93514f5234e8a51c6294b3f.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_998ab703c93514f5234e8a51c6294b3f.jpg saved to cache
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd2ca10>
2026-03-28 10:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_b8b1cf820543265bc19484a4e6ffd872.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_b8b1cf820543265bc19484a4e6ffd872.jpg saved to cache
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeb1150>
2026-03-28 10:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F1e%252F221e5e5c8e09b598dbf425353e19b165%252Fpa%252FZR61272_10cab29d7783adf964561dad3035af6d.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_10cab29d7783adf964561dad3035af6d.jpg saved to cache
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bcb4f497-9e25-55a0-b724-bb623217da7d
2026-03-28 10:38:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcb4f497-9e25-55a0-b724-bb623217da7d, skipping ID generation
2026-03-28 10:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcb4f497-9e25-55a0-b724-bb623217da7d with scrape type 1
2026-03-28 10:38:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcb4f497-9e25-55a0-b724-bb623217da7d sending to next pipeline
2026-03-28 10:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcb4f497-9e25-55a0-b724-bb623217da7d, identifier: ZR61272
2026-03-28 10:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG97842/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993
2026-03-28 10:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993
2026-03-28 10:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52995c24-6e8c-547b-9aa5-966c7278154e with identifier: DA97993 to the API
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_1b03366830a275b5cb15aca6ae846223.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:08:11Z',
 'fuel_type': 'diesel',
 'id': '52995c24-6e8c-547b-9aa5-966c7278154e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA97993',
 'listing': 'auction',
 'location': 'DE, Magdeburg',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 171886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3095697,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_1b03366830a275b5cb15aca6ae846223.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_0182cd712c11f54e9d2d136a420cf410.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_61179ef2c0bb9046e63b30ff66f9ec8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_5e801cd864b76c80306169ea4ce39882.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2853801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_b18a7cbac8ea86f3e4ccd918a11e16c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2618897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_d627504b88701fec82009deb0c859478.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e9c95b53a6bf8831aa84fcef73ee54b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2514957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e9bc729e402788cbbd5c69c14e7cab95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_e6ae303ba917e03d64ada5ab8f01ccd5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52995c24-6e8c-547b-9aa5-966c7278154e/52995c24-6e8c-547b-9aa5-966c7278154e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/21/c621287ac7f03ec93381749dbe61022c/pa/DA97993_d4193adc9ac9a288657a02a4e926c254.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline BlueMotion Tech.',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech.',
 'year': 2013}
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA97993%27 HTTP/1.1" 200 None
2026-03-28 10:38:39 [auto1.de] INFO: Saving data for DA97993: {'created_time': 1774694319.865234, 'last_price_update_time': 1774694319.865247, 'auction_closing_time': 1774883291.0}
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA97993') HTTP/1.1" 204 0
2026-03-28 10:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272
2026-03-28 10:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272
2026-03-28 10:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcb4f497-9e25-55a0-b724-bb623217da7d with identifier: ZR61272 to the API
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_10cab29d7783adf964561dad3035af6d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:26:41Z',
 'fuel_type': 'diesel',
 'id': 'bcb4f497-9e25-55a0-b724-bb623217da7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR61272',
 'listing': 'auction',
 'location': 'DE, Schwerin',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 207080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_b8b1cf820543265bc19484a4e6ffd872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2902294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_10cab29d7783adf964561dad3035af6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2873911,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_998ab703c93514f5234e8a51c6294b3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_3e3212693254993f5cd856d9f06969cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2974743,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_fc18791241634eddd517c6e50da05830.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_40cf37cae9c81cb7b62fe1de28d43bcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3102774,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_b62a1a554f32f87cba0a33031e3ecbf6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2871787,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_e77498049135198e168a0cfa943ba291.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2925294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_9230c8e63af699a5470c4a45abdccb44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bcb4f497-9e25-55a0-b724-bb623217da7d/bcb4f497-9e25-55a0-b724-bb623217da7d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2997553,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/1e/221e5e5c8e09b598dbf425353e19b165/pa/ZR61272_7192e6d071a2a12f22ed71c3c11f5133.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2014}
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR61272%27 HTTP/1.1" 200 None
2026-03-28 10:38:40 [auto1.de] INFO: Saving data for ZR61272: {'created_time': 1774694320.306227, 'last_price_update_time': 1774694320.30624, 'auction_closing_time': 1774884401.0}
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR61272') HTTP/1.1" 204 0
2026-03-28 10:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc01850>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_190b4c1a10ad86c865e5165cc8c12e68.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_190b4c1a10ad86c865e5165cc8c12e68.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5a590>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_896032963d272c5deb121edee0f0d549.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_896032963d272c5deb121edee0f0d549.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_b0933abcc1a618ffda6109e71b899ee8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_1bb6a1b27f2cb51e5614a752041864c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_1568e13bff9af8cf2d8ee03fb072aae3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_cb9884c6c1e49972563e33b3c1dd7db8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_80af19641305669fed0d23235e819620.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_a38c7625c4501bbda5e9a04bee81ba78.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef1dd0>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_b0933abcc1a618ffda6109e71b899ee8.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_b0933abcc1a618ffda6109e71b899ee8.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb98d0>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_1bb6a1b27f2cb51e5614a752041864c5.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_1bb6a1b27f2cb51e5614a752041864c5.jpg saved to cache
2026-03-28 10:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe35250>
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_1568e13bff9af8cf2d8ee03fb072aae3.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_1568e13bff9af8cf2d8ee03fb072aae3.jpg saved to cache
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb41d0>
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_cb9884c6c1e49972563e33b3c1dd7db8.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_cb9884c6c1e49972563e33b3c1dd7db8.jpg saved to cache
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf96fd0>
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_80af19641305669fed0d23235e819620.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_80af19641305669fed0d23235e819620.jpg saved to cache
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdbb8d0>
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_a38c7625c4501bbda5e9a04bee81ba78.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_a38c7625c4501bbda5e9a04bee81ba78.jpg saved to cache
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AD84103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EH91582> (referer: https://www.auto1.com/v1/car-details-view/EH91582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE92374/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582
2026-03-28 10:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a41971-c6f3-510c-954d-42f399c3ec57 with scrape type 1
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81a41971-c6f3-510c-954d-42f399c3ec57
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_a45668b7a993c55ee0aa20c3fcbe34b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_a45668b7a993c55ee0aa20c3fcbe34b7.jpg already downloaded
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_32417bfe6cb8537c3636a8886d6e138c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_32417bfe6cb8537c3636a8886d6e138c.jpg already downloaded
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_03830262bb6457aec903014e9add2b0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_03830262bb6457aec903014e9add2b0c.jpg already downloaded
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_1900cb8086f8d7d68369594116a50540.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_1900cb8086f8d7d68369594116a50540.jpg already downloaded
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_e6a6eb9367c707b5fc22781faa3b6294.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_e6a6eb9367c707b5fc22781faa3b6294.jpg already downloaded
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_2e06d25518ec81741e1c912f4ef12102.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_2e06d25518ec81741e1c912f4ef12102.jpg already downloaded
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_ccfa53eb12849714fb8f4cf32344c918.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_ccfa53eb12849714fb8f4cf32344c918.jpg already downloaded
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_f74d64c815de1b63af37d86eb1315504.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_f74d64c815de1b63af37d86eb1315504.jpg already downloaded
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_84b737159cd793ce72cec18c0687906a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_84b737159cd793ce72cec18c0687906a.jpg already downloaded
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdd%252F14%252Fdd1406266670e8af7fa403fedc4202a3%252Fpa%252FEH91582_1d4a952e993938a1259f248c200aef87.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_1d4a952e993938a1259f248c200aef87.jpg already downloaded
2026-03-28 10:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81a41971-c6f3-510c-954d-42f399c3ec57, identifier: EH91582
2026-03-28 10:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 10:38:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582
2026-03-28 10:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81a41971-c6f3-510c-954d-42f399c3ec57 with identifier: EH91582 to the API
2026-03-28 10:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EH91582>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:00:45Z',
 'fuel_type': 'petrol',
 'id': '81a41971-c6f3-510c-954d-42f399c3ec57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH91582',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 105169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_a45668b7a993c55ee0aa20c3fcbe34b7.jpg',
                'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_32417bfe6cb8537c3636a8886d6e138c.jpg',
                'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_03830262bb6457aec903014e9add2b0c.jpg',
                'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_1900cb8086f8d7d68369594116a50540.jpg',
                'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_e6a6eb9367c707b5fc22781faa3b6294.jpg',
                'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_2e06d25518ec81741e1c912f4ef12102.jpg',
                'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_ccfa53eb12849714fb8f4cf32344c918.jpg',
                'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_f74d64c815de1b63af37d86eb1315504.jpg',
                'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_84b737159cd793ce72cec18c0687906a.jpg',
                'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_1d4a952e993938a1259f248c200aef87.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_a45668b7a993c55ee0aa20c3fcbe34b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_32417bfe6cb8537c3636a8886d6e138c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_03830262bb6457aec903014e9add2b0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_1900cb8086f8d7d68369594116a50540.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_e6a6eb9367c707b5fc22781faa3b6294.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_2e06d25518ec81741e1c912f4ef12102.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_ccfa53eb12849714fb8f4cf32344c918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_f74d64c815de1b63af37d86eb1315504.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_84b737159cd793ce72cec18c0687906a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a41971-c6f3-510c-954d-42f399c3ec57/81a41971-c6f3-510c-954d-42f399c3ec57_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdd/14/dd1406266670e8af7fa403fedc4202a3/pa/EH91582_1d4a952e993938a1259f248c200aef87.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2014}
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91582%27 HTTP/1.1" 200 None
2026-03-28 10:38:42 [auto1.de] INFO: Saving data for EH91582: {'created_time': 1774694322.227487, 'last_price_update_time': 1774694322.227499, 'auction_closing_time': 1774882845.0}
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH91582') HTTP/1.1" 204 0
2026-03-28 10:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_5080ad796d0fbc49e083fbf007eb27ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad1850>
2026-03-28 10:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6e%252Fa6%252F6ea6777877ceeb1707bc215384e75940%252Fpa%252FNV43592_5080ad796d0fbc49e083fbf007eb27ad.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_5080ad796d0fbc49e083fbf007eb27ad.jpg saved to cache
2026-03-28 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c
2026-03-28 10:38:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c, skipping ID generation
2026-03-28 10:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with scrape type 1
2026-03-28 10:38:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f55ea5d-89ce-55b9-9fb0-fb45030a874c sending to next pipeline
2026-03-28 10:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c, identifier: NV43592
2026-03-28 10:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592
2026-03-28 10:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592
2026-03-28 10:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f55ea5d-89ce-55b9-9fb0-fb45030a874c with identifier: NV43592 to the API
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_5080ad796d0fbc49e083fbf007eb27ad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:05Z',
 'fuel_type': 'diesel',
 'id': '1f55ea5d-89ce-55b9-9fb0-fb45030a874c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV43592',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 221725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_5080ad796d0fbc49e083fbf007eb27ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2696220,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_80af19641305669fed0d23235e819620.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_cb9884c6c1e49972563e33b3c1dd7db8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2684277,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_1bb6a1b27f2cb51e5614a752041864c5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_1568e13bff9af8cf2d8ee03fb072aae3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2045506,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_b0933abcc1a618ffda6109e71b899ee8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_a38c7625c4501bbda5e9a04bee81ba78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_896032963d272c5deb121edee0f0d549.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2185143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_190b4c1a10ad86c865e5165cc8c12e68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f55ea5d-89ce-55b9-9fb0-fb45030a874c/1f55ea5d-89ce-55b9-9fb0-fb45030a874c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6e/a6/6ea6777877ceeb1707bc215384e75940/pa/NV43592_8183193c1d214de122e43f500b730395.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-19',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2013}
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV43592%27 HTTP/1.1" 200 None
2026-03-28 10:38:42 [auto1.de] INFO: Saving data for NV43592: {'created_time': 1774694322.978863, 'last_price_update_time': 1774694322.978877, 'auction_closing_time': 1774885505.0}
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV43592') HTTP/1.1" 204 0
2026-03-28 10:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG97842> (referer: https://www.auto1.com/v1/car-details-view/AG97842/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842
2026-03-28 10:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with scrape type 1
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_72f6b5b7d23b5408d950d105b816ccc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_72f6b5b7d23b5408d950d105b816ccc1.jpg already downloaded
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_8631103051495d5f2adb47fb2a17b8d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_8631103051495d5f2adb47fb2a17b8d0.jpg already downloaded
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_d3655b23465a646b63c8ed727d147489.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_d3655b23465a646b63c8ed727d147489.jpg already downloaded
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_c4faf99ac81236c5a81eb9e38a7a4b4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_c4faf99ac81236c5a81eb9e38a7a4b4f.jpg already downloaded
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_e523373a3ecc7b4c8b6d8c6dee9e2e3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_e523373a3ecc7b4c8b6d8c6dee9e2e3d.jpg already downloaded
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_b73c3c2910297276f0a4c75a8ce5b3d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_b73c3c2910297276f0a4c75a8ce5b3d4.jpg already downloaded
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_8ee2c1aea61f537bb95edd1243b2cdb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_8ee2c1aea61f537bb95edd1243b2cdb0.jpg already downloaded
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_73fad92ad60e05f81d287914aa099b36.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_73fad92ad60e05f81d287914aa099b36.jpg already downloaded
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_e1802d8785271d036d26f88f0b67796b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_e1802d8785271d036d26f88f0b67796b.jpg already downloaded
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg51%252F20%252F5120d879d149b36ff60f25c7fba3248a%252Fpa%252FAG97842_0d7502e83e5c51fb7de3dded1c7126f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_0d7502e83e5c51fb7de3dded1c7126f7.jpg already downloaded
2026-03-28 10:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46, identifier: AG97842
2026-03-28 10:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842
2026-03-28 10:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842
2026-03-28 10:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c00e65f-51fe-5c96-b9f6-8f699b1ebe46 with identifier: AG97842 to the API
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AG97842>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:27:24Z',
 'fuel_type': 'petrol',
 'id': '9c00e65f-51fe-5c96-b9f6-8f699b1ebe46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG97842',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 88272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_72f6b5b7d23b5408d950d105b816ccc1.jpg',
                'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_8631103051495d5f2adb47fb2a17b8d0.jpg',
                'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_d3655b23465a646b63c8ed727d147489.jpg',
                'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_c4faf99ac81236c5a81eb9e38a7a4b4f.jpg',
                'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_e523373a3ecc7b4c8b6d8c6dee9e2e3d.jpg',
                'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_b73c3c2910297276f0a4c75a8ce5b3d4.jpg',
                'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_8ee2c1aea61f537bb95edd1243b2cdb0.jpg',
                'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_73fad92ad60e05f81d287914aa099b36.jpg',
                'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_e1802d8785271d036d26f88f0b67796b.jpg',
                'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_0d7502e83e5c51fb7de3dded1c7126f7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_72f6b5b7d23b5408d950d105b816ccc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_8631103051495d5f2adb47fb2a17b8d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_d3655b23465a646b63c8ed727d147489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_c4faf99ac81236c5a81eb9e38a7a4b4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_e523373a3ecc7b4c8b6d8c6dee9e2e3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_b73c3c2910297276f0a4c75a8ce5b3d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_8ee2c1aea61f537bb95edd1243b2cdb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_73fad92ad60e05f81d287914aa099b36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_e1802d8785271d036d26f88f0b67796b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c00e65f-51fe-5c96-b9f6-8f699b1ebe46/9c00e65f-51fe-5c96-b9f6-8f699b1ebe46_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img51/20/5120d879d149b36ff60f25c7fba3248a/pa/AG97842_0d7502e83e5c51fb7de3dded1c7126f7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Dokker 1.2 TCe Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2017}
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG97842%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [auto1.de] INFO: Saving data for AG97842: {'created_time': 1774694324.715576, 'last_price_update_time': 1774694324.715586, 'auction_closing_time': 1774884444.0}
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG97842') HTTP/1.1" 204 0
2026-03-28 10:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX44847> (referer: https://www.auto1.com/v1/car-details-view/LX44847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847
2026-03-28 10:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b185f9-2494-5a2f-b23c-65840b646c05 with scrape type 1
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_253d42adaec76203a351e328b3d39e5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_253d42adaec76203a351e328b3d39e5e.jpg not downloaded yet
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_0b2bb2428ce9dde391400992d197f587.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_0b2bb2428ce9dde391400992d197f587.jpg not downloaded yet
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_1f261bda0bf17e27b0b23d49afb4e3fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_1f261bda0bf17e27b0b23d49afb4e3fa.jpg not downloaded yet
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_f5d6ec3531d75fa14c681a87d59f01e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_f5d6ec3531d75fa14c681a87d59f01e7.jpg not downloaded yet
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_9cf9344ec9e6f83ec78184af9e1c5201.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_9cf9344ec9e6f83ec78184af9e1c5201.jpg not downloaded yet
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_c7256dd437515264fc670cef1f4f77db.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_c7256dd437515264fc670cef1f4f77db.jpg not downloaded yet
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_0b6400d4d06c909a5d090d75ca83d7a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_0b6400d4d06c909a5d090d75ca83d7a1.jpg not downloaded yet
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_896919132f1c682c08b16229b2896e52.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_896919132f1c682c08b16229b2896e52.jpg not downloaded yet
2026-03-28 10:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_bea0ae09ee107b0f2e9df7dd67d1e805.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_bea0ae09ee107b0f2e9df7dd67d1e805.jpg not downloaded yet
2026-03-28 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_313d8446e4ec1646c7a214bad415ba34.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_313d8446e4ec1646c7a214bad415ba34.jpg not downloaded yet
2026-03-28 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM85467> (referer: https://www.auto1.com/v1/car-details-view/DM85467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB69200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY89611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 096f5cab-8e91-564c-804f-f981693240a8 with identifier: DM85467
2026-03-28 10:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096f5cab-8e91-564c-804f-f981693240a8 with scrape type 1
2026-03-28 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_055c20ce2ef5d9afc537e5d89263d72a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_055c20ce2ef5d9afc537e5d89263d72a.jpg not downloaded yet
2026-03-28 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_6a176f7d53bc1a5f77ae2614a2413e2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_6a176f7d53bc1a5f77ae2614a2413e2e.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_efd5482edd7d5310152c039b337624bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_efd5482edd7d5310152c039b337624bc.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_bda15d92076063386f38db59618b79c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_bda15d92076063386f38db59618b79c9.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_60f91100d033b0e8c59d55a873510e63.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_60f91100d033b0e8c59d55a873510e63.jpg not downloaded yet
2026-03-28 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LA95104> (referer: https://www.auto1.com/v1/car-details-view/LA95104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_9fb1c1106c8148e8df409cea2898407f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_9fb1c1106c8148e8df409cea2898407f.jpg not downloaded yet
2026-03-28 10:38:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_313d8446e4ec1646c7a214bad415ba34.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_b7b5f09159cfac1a75ce5ffe8dc0fb76.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_b7b5f09159cfac1a75ce5ffe8dc0fb76.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_17073f99480b0a3844077a6866d34944.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_17073f99480b0a3844077a6866d34944.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_50c447e7830a56218b7ae77d14abb095.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_50c447e7830a56218b7ae77d14abb095.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_62d8aa14cd66eb496374dc7b4fb2bc28.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_62d8aa14cd66eb496374dc7b4fb2bc28.jpg not downloaded yet
2026-03-28 10:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104
2026-03-28 10:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with scrape type 1
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_5e45c0c1fffc4ff61ed44e68e493070a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_5e45c0c1fffc4ff61ed44e68e493070a.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_ff292e70f0a11874113d3c85e2bae2ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_ff292e70f0a11874113d3c85e2bae2ff.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_f82c3fcfe2181ba59e0cf39a7c192a41.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_f82c3fcfe2181ba59e0cf39a7c192a41.jpg not downloaded yet
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad1010>
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_313d8446e4ec1646c7a214bad415ba34.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_313d8446e4ec1646c7a214bad415ba34.jpg saved to cache
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_f4b21920af493c4aad8012fce725ad6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_f4b21920af493c4aad8012fce725ad6b.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_230f5e3e9b7263b853430eef5a2e2397.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_230f5e3e9b7263b853430eef5a2e2397.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_a48f5ea3e11dbf8d92cd534026ecc5e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_a48f5ea3e11dbf8d92cd534026ecc5e4.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_8e12a12759b199009dc0bb9f2f3aa6b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_8e12a12759b199009dc0bb9f2f3aa6b8.jpg not downloaded yet
2026-03-28 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_896919132f1c682c08b16229b2896e52.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_564bcaf60b5847aaa01f0a12bee628f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_564bcaf60b5847aaa01f0a12bee628f7.jpg not downloaded yet
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_4742c288ab2c3b143078c6ac2b2540dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_4742c288ab2c3b143078c6ac2b2540dc.jpg not downloaded yet
2026-03-28 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_bea0ae09ee107b0f2e9df7dd67d1e805.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_a69f06d6ce1cdb4b9ca4621932658341.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_a69f06d6ce1cdb4b9ca4621932658341.jpg not downloaded yet
2026-03-28 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_60f91100d033b0e8c59d55a873510e63.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a00110>
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_896919132f1c682c08b16229b2896e52.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_896919132f1c682c08b16229b2896e52.jpg saved to cache
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_a69f06d6ce1cdb4b9ca4621932658341.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_8e12a12759b199009dc0bb9f2f3aa6b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfba250>
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_bea0ae09ee107b0f2e9df7dd67d1e805.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_bea0ae09ee107b0f2e9df7dd67d1e805.jpg saved to cache
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ac8481e50>
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_60f91100d033b0e8c59d55a873510e63.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_60f91100d033b0e8c59d55a873510e63.jpg saved to cache
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ50371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf761d0>
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_a69f06d6ce1cdb4b9ca4621932658341.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_a69f06d6ce1cdb4b9ca4621932658341.jpg saved to cache
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88adad0>
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_8e12a12759b199009dc0bb9f2f3aa6b8.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_8e12a12759b199009dc0bb9f2f3aa6b8.jpg saved to cache
2026-03-28 10:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_564bcaf60b5847aaa01f0a12bee628f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_230f5e3e9b7263b853430eef5a2e2397.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88c8cd0>
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_564bcaf60b5847aaa01f0a12bee628f7.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_564bcaf60b5847aaa01f0a12bee628f7.jpg saved to cache
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_4742c288ab2c3b143078c6ac2b2540dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_a48f5ea3e11dbf8d92cd534026ecc5e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_f4b21920af493c4aad8012fce725ad6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc8b50>
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_230f5e3e9b7263b853430eef5a2e2397.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_230f5e3e9b7263b853430eef5a2e2397.jpg saved to cache
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_f82c3fcfe2181ba59e0cf39a7c192a41.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_ff292e70f0a11874113d3c85e2bae2ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf36150>
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_4742c288ab2c3b143078c6ac2b2540dc.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_4742c288ab2c3b143078c6ac2b2540dc.jpg saved to cache
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf41650>
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_a48f5ea3e11dbf8d92cd534026ecc5e4.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_a48f5ea3e11dbf8d92cd534026ecc5e4.jpg saved to cache
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe8c4d0>
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_f4b21920af493c4aad8012fce725ad6b.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_f4b21920af493c4aad8012fce725ad6b.jpg saved to cache
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_5e45c0c1fffc4ff61ed44e68e493070a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda6d90>
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_f82c3fcfe2181ba59e0cf39a7c192a41.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_f82c3fcfe2181ba59e0cf39a7c192a41.jpg saved to cache
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe91a90>
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_ff292e70f0a11874113d3c85e2bae2ff.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_ff292e70f0a11874113d3c85e2bae2ff.jpg saved to cache
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_62d8aa14cd66eb496374dc7b4fb2bc28.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_50c447e7830a56218b7ae77d14abb095.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5a310>
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fa3%252Fdfa31f6f8c95452aac908e4eea644160%252Fpa%252FLA95104_5e45c0c1fffc4ff61ed44e68e493070a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_5e45c0c1fffc4ff61ed44e68e493070a.jpg saved to cache
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08
2026-03-28 10:38:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08, skipping ID generation
2026-03-28 10:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with scrape type 1
2026-03-28 10:38:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 sending to next pipeline
2026-03-28 10:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08, identifier: LA95104
2026-03-28 10:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104
2026-03-28 10:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104
2026-03-28 10:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08 with identifier: LA95104 to the API
2026-03-28 10:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_5e45c0c1fffc4ff61ed44e68e493070a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:28:34Z',
 'fuel_type': 'petrol',
 'id': '9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA95104',
 'listing': 'auction',
 'location': 'DE, Böblingen',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 37546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_5e45c0c1fffc4ff61ed44e68e493070a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_ff292e70f0a11874113d3c85e2bae2ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_f82c3fcfe2181ba59e0cf39a7c192a41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2258348,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_f4b21920af493c4aad8012fce725ad6b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2222103,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_230f5e3e9b7263b853430eef5a2e2397.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_a48f5ea3e11dbf8d92cd534026ecc5e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_8e12a12759b199009dc0bb9f2f3aa6b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_564bcaf60b5847aaa01f0a12bee628f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70710,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_4742c288ab2c3b143078c6ac2b2540dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08/9b6d2b04-f5b4-5210-852f-4b7b0a0cdf08_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/a3/dfa31f6f8c95452aac908e4eea644160/pa/LA95104_a69f06d6ce1cdb4b9ca4621932658341.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-23',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 0.9 TCe Le Coq Sportif',
 'transmission': 'automatic',
 'trim': 'Le Coq Sportif',
 'year': 2019}
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA95104%27 HTTP/1.1" 200 None
2026-03-28 10:38:48 [auto1.de] INFO: Saving data for LA95104: {'created_time': 1774694328.313199, 'last_price_update_time': 1774694328.313212, 'auction_closing_time': 1774884514.0}
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA95104') HTTP/1.1" 204 0
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_17073f99480b0a3844077a6866d34944.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_b7b5f09159cfac1a75ce5ffe8dc0fb76.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE69038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA12194/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ13405/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM10226/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb8090>
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_62d8aa14cd66eb496374dc7b4fb2bc28.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_62d8aa14cd66eb496374dc7b4fb2bc28.jpg saved to cache
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a0cc50>
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_50c447e7830a56218b7ae77d14abb095.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_50c447e7830a56218b7ae77d14abb095.jpg saved to cache
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeeb950>
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_17073f99480b0a3844077a6866d34944.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_17073f99480b0a3844077a6866d34944.jpg saved to cache
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe17c10>
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_b7b5f09159cfac1a75ce5ffe8dc0fb76.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_b7b5f09159cfac1a75ce5ffe8dc0fb76.jpg saved to cache
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_055c20ce2ef5d9afc537e5d89263d72a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_efd5482edd7d5310152c039b337624bc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_0b6400d4d06c909a5d090d75ca83d7a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_9fb1c1106c8148e8df409cea2898407f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_bda15d92076063386f38db59618b79c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_6a176f7d53bc1a5f77ae2614a2413e2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba7c0990>
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_055c20ce2ef5d9afc537e5d89263d72a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_055c20ce2ef5d9afc537e5d89263d72a.jpg saved to cache
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe51710>
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_efd5482edd7d5310152c039b337624bc.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_efd5482edd7d5310152c039b337624bc.jpg saved to cache
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba7c3b10>
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_0b6400d4d06c909a5d090d75ca83d7a1.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_0b6400d4d06c909a5d090d75ca83d7a1.jpg saved to cache
2026-03-28 10:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:38:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a09450>
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_9fb1c1106c8148e8df409cea2898407f.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_9fb1c1106c8148e8df409cea2898407f.jpg saved to cache
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdf650>
2026-03-28 10:38:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_bda15d92076063386f38db59618b79c9.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_bda15d92076063386f38db59618b79c9.jpg saved to cache
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a03350>
2026-03-28 10:38:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252F75%252Fc87525ea2e4a6f53f69cf0eadcf4f251%252Fpa%252FDM85467_6a176f7d53bc1a5f77ae2614a2413e2e.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_6a176f7d53bc1a5f77ae2614a2413e2e.jpg saved to cache
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 096f5cab-8e91-564c-804f-f981693240a8
2026-03-28 10:38:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 096f5cab-8e91-564c-804f-f981693240a8, skipping ID generation
2026-03-28 10:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096f5cab-8e91-564c-804f-f981693240a8 with scrape type 1
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 096f5cab-8e91-564c-804f-f981693240a8 sending to next pipeline
2026-03-28 10:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 096f5cab-8e91-564c-804f-f981693240a8, identifier: DM85467
2026-03-28 10:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 096f5cab-8e91-564c-804f-f981693240a8 with identifier: DM85467
2026-03-28 10:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 096f5cab-8e91-564c-804f-f981693240a8 with identifier: DM85467
2026-03-28 10:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 096f5cab-8e91-564c-804f-f981693240a8 with identifier: DM85467 to the API
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_6a176f7d53bc1a5f77ae2614a2413e2e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:13:23Z',
 'fuel_type': 'petrol',
 'id': '096f5cab-8e91-564c-804f-f981693240a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM85467',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 206619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_055c20ce2ef5d9afc537e5d89263d72a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_6a176f7d53bc1a5f77ae2614a2413e2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_efd5482edd7d5310152c039b337624bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672180,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_bda15d92076063386f38db59618b79c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3511856,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_60f91100d033b0e8c59d55a873510e63.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3323260,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_9fb1c1106c8148e8df409cea2898407f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_b7b5f09159cfac1a75ce5ffe8dc0fb76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_17073f99480b0a3844077a6866d34944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3199759,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_50c447e7830a56218b7ae77d14abb095.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_096f5cab-8e91-564c-804f-f981693240a8/096f5cab-8e91-564c-804f-f981693240a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/75/c87525ea2e4a6f53f69cf0eadcf4f251/pa/DM85467_62d8aa14cd66eb496374dc7b4fb2bc28.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 2.0 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM85467%27 HTTP/1.1" 200 None
2026-03-28 10:38:49 [auto1.de] INFO: Saving data for DM85467: {'created_time': 1774694329.765789, 'last_price_update_time': 1774694329.765801, 'auction_closing_time': 1774883603.0}
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM85467') HTTP/1.1" 204 0
2026-03-28 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE92374> (referer: https://www.auto1.com/v1/car-details-view/XE92374/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AD84103> (referer: https://www.auto1.com/v1/car-details-view/AD84103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374
2026-03-28 10:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c23c2c-e67e-5a29-8050-c0aa11265903 with scrape type 1
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_ac8c5ab5812ce73322de6957e4e433cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_ac8c5ab5812ce73322de6957e4e433cb.jpg not downloaded yet
2026-03-28 10:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103
2026-03-28 10:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1609c20e-b5f6-584f-a876-6176ac2bfe54 with scrape type 1
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_be62e7f5a59f26eae2f770f21778f19f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_be62e7f5a59f26eae2f770f21778f19f.jpg not downloaded yet
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_2a3bbfa341d3c075133545aefa9be12c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_2a3bbfa341d3c075133545aefa9be12c.jpg not downloaded yet
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_88ad8d63776a7c6744ceb93f6b767cbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_88ad8d63776a7c6744ceb93f6b767cbd.jpg not downloaded yet
2026-03-28 10:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_9cf9344ec9e6f83ec78184af9e1c5201.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_1fc828754bd9c31a83dbae9653e3ade3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_1fc828754bd9c31a83dbae9653e3ade3.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_2507969b3ca9b61a906f35540f2b99ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_2507969b3ca9b61a906f35540f2b99ed.jpg not downloaded yet
2026-03-28 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_c7256dd437515264fc670cef1f4f77db.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_909b023b2c2bc1cf9908944c941db520.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_909b023b2c2bc1cf9908944c941db520.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_1be1ed629ef6e4a3b36657ba2cbb02ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_1be1ed629ef6e4a3b36657ba2cbb02ec.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_028de27a7e07d4f837b060162b70d8e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_028de27a7e07d4f837b060162b70d8e0.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_aa564c7333466db78a7a43eaa626a0f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_aa564c7333466db78a7a43eaa626a0f2.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_d06039d70c7acf6f27e12d9ea16dc157.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_d06039d70c7acf6f27e12d9ea16dc157.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_8ebde63220510bf0f59a2ce4dd216d3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_8ebde63220510bf0f59a2ce4dd216d3a.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_32fa74a4f182b94f1f2e4b08d42ea671.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_32fa74a4f182b94f1f2e4b08d42ea671.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_839eaeefea339098a86e48cbbef1b1b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_839eaeefea339098a86e48cbbef1b1b6.jpg not downloaded yet
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8913d90>
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_9cf9344ec9e6f83ec78184af9e1c5201.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_9cf9344ec9e6f83ec78184af9e1c5201.jpg saved to cache
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_ddc1052bf6ad1647e2841a3b50b0c638.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_ddc1052bf6ad1647e2841a3b50b0c638.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_780a3a45498a2c3e0cfd97711a630707.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_780a3a45498a2c3e0cfd97711a630707.jpg not downloaded yet
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a61bd0>
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_c7256dd437515264fc670cef1f4f77db.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_c7256dd437515264fc670cef1f4f77db.jpg saved to cache
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_e17c74642421058c0aa7c876459a240b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_e17c74642421058c0aa7c876459a240b.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_aa806414671cbd69f067839ecb960d5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_aa806414671cbd69f067839ecb960d5d.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_3300664262ab894cfab827a1ad9ede1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_3300664262ab894cfab827a1ad9ede1a.jpg not downloaded yet
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_afc4143528d46942f2205bcb138e463c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_afc4143528d46942f2205bcb138e463c.jpg not downloaded yet
2026-03-28 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_f5d6ec3531d75fa14c681a87d59f01e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_1f261bda0bf17e27b0b23d49afb4e3fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_be62e7f5a59f26eae2f770f21778f19f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_2507969b3ca9b61a906f35540f2b99ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe50d10>
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_f5d6ec3531d75fa14c681a87d59f01e7.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_f5d6ec3531d75fa14c681a87d59f01e7.jpg saved to cache
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY14416/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88eb7d0>
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_1f261bda0bf17e27b0b23d49afb4e3fa.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_1f261bda0bf17e27b0b23d49afb4e3fa.jpg saved to cache
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:38:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd42e90>
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_be62e7f5a59f26eae2f770f21778f19f.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_be62e7f5a59f26eae2f770f21778f19f.jpg saved to cache
2026-03-28 10:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd56350>
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_2507969b3ca9b61a906f35540f2b99ed.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_2507969b3ca9b61a906f35540f2b99ed.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ50371> (referer: https://www.auto1.com/v1/car-details-view/TJ50371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_afc4143528d46942f2205bcb138e463c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB69200> (referer: https://www.auto1.com/v1/car-details-view/BB69200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_3300664262ab894cfab827a1ad9ede1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_ddc1052bf6ad1647e2841a3b50b0c638.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371
2026-03-28 10:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b4971d-294a-5961-a0bf-9ede159beb09 with scrape type 1
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 71b4971d-294a-5961-a0bf-9ede159beb09
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_d514b617d2b59986cd289efecad5f5b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_d514b617d2b59986cd289efecad5f5b1.jpg not downloaded yet
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_32fa74a4f182b94f1f2e4b08d42ea671.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_265a140087d4150898af4d6a8126dae4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_265a140087d4150898af4d6a8126dae4.jpg not downloaded yet
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_75f372a7054b5b76faaf3aefaa8ef478.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_75f372a7054b5b76faaf3aefaa8ef478.jpg not downloaded yet
2026-03-28 10:38:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd2c490>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_afc4143528d46942f2205bcb138e463c.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_afc4143528d46942f2205bcb138e463c.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_e17c74642421058c0aa7c876459a240b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_aa806414671cbd69f067839ecb960d5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_caa8cb8461bc5f7b2bc2165400ceae2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_caa8cb8461bc5f7b2bc2165400ceae2f.jpg not downloaded yet
2026-03-28 10:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8af5e4f7-661c-539f-ba7c-adb55179fed1 with identifier: BB69200
2026-03-28 10:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8af5e4f7-661c-539f-ba7c-adb55179fed1 with scrape type 1
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_14ec2742d3e35ee719070cb29582ae68.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_14ec2742d3e35ee719070cb29582ae68.jpg not downloaded yet
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd50090>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_3300664262ab894cfab827a1ad9ede1a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_3300664262ab894cfab827a1ad9ede1a.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_d514b617d2b59986cd289efecad5f5b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_8cb5d31609bd7a39074e1189653befdf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_8cb5d31609bd7a39074e1189653befdf.jpg not downloaded yet
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_7b5273085d2a98324363d0cb01d58148.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_7b5273085d2a98324363d0cb01d58148.jpg not downloaded yet
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef7c10>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_ddc1052bf6ad1647e2841a3b50b0c638.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_ddc1052bf6ad1647e2841a3b50b0c638.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88dc150>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_32fa74a4f182b94f1f2e4b08d42ea671.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_32fa74a4f182b94f1f2e4b08d42ea671.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_6a5d8cd76dcf91c0366b80dc68bf9c2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_6a5d8cd76dcf91c0366b80dc68bf9c2d.jpg not downloaded yet
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_265a140087d4150898af4d6a8126dae4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_75f372a7054b5b76faaf3aefaa8ef478.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf62410>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_e17c74642421058c0aa7c876459a240b.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_e17c74642421058c0aa7c876459a240b.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba802e90>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_aa806414671cbd69f067839ecb960d5d.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_aa806414671cbd69f067839ecb960d5d.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5f950>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_d514b617d2b59986cd289efecad5f5b1.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_d514b617d2b59986cd289efecad5f5b1.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71b4971d-294a-5961-a0bf-9ede159beb09
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_0ef66aba725a8195c2b0120af8c25dc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_0ef66aba725a8195c2b0120af8c25dc0.jpg not downloaded yet
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_caa8cb8461bc5f7b2bc2165400ceae2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_c4bba0b671bacfc89c3606e31b6b244f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_c4bba0b671bacfc89c3606e31b6b244f.jpg not downloaded yet
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd9ca50>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_265a140087d4150898af4d6a8126dae4.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_265a140087d4150898af4d6a8126dae4.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71b4971d-294a-5961-a0bf-9ede159beb09
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed5610>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_75f372a7054b5b76faaf3aefaa8ef478.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_75f372a7054b5b76faaf3aefaa8ef478.jpg saved to cache
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71b4971d-294a-5961-a0bf-9ede159beb09
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_07fd1a6773aafe1b98a818e856ef7141.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_07fd1a6773aafe1b98a818e856ef7141.jpg not downloaded yet
2026-03-28 10:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_8cb5d31609bd7a39074e1189653befdf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_14b1a134681a0c02cd39d8f8bade0e90.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_14b1a134681a0c02cd39d8f8bade0e90.jpg not downloaded yet
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_1b85f383979e58cf387dbdd793f3fde2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_1b85f383979e58cf387dbdd793f3fde2.jpg not downloaded yet
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf4ce50>
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_caa8cb8461bc5f7b2bc2165400ceae2f.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_caa8cb8461bc5f7b2bc2165400ceae2f.jpg saved to cache
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71b4971d-294a-5961-a0bf-9ede159beb09
2026-03-28 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_780a3a45498a2c3e0cfd97711a630707.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_7b5273085d2a98324363d0cb01d58148.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_e3f66f54e7ea7b84fc35ed648b33d895.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_e3f66f54e7ea7b84fc35ed648b33d895.jpg not downloaded yet
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_93380ff02bfc8114517bac84b0636bfc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_93380ff02bfc8114517bac84b0636bfc.jpg not downloaded yet
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabee9f10>
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fe1%252F81e1f6ed93b53e75f17123057f28147f%252Fpa%252FTJ50371_8cb5d31609bd7a39074e1189653befdf.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_8cb5d31609bd7a39074e1189653befdf.jpg saved to cache
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71b4971d-294a-5961-a0bf-9ede159beb09
2026-03-28 10:38:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71b4971d-294a-5961-a0bf-9ede159beb09, skipping ID generation
2026-03-28 10:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b4971d-294a-5961-a0bf-9ede159beb09 with scrape type 1
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71b4971d-294a-5961-a0bf-9ede159beb09 sending to next pipeline
2026-03-28 10:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71b4971d-294a-5961-a0bf-9ede159beb09, identifier: TJ50371
2026-03-28 10:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371
2026-03-28 10:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371
2026-03-28 10:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71b4971d-294a-5961-a0bf-9ede159beb09 with identifier: TJ50371 to the API
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_8cb5d31609bd7a39074e1189653befdf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.4L',
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:50:45Z',
 'fuel_type': 'petrol',
 'id': '71b4971d-294a-5961-a0bf-9ede159beb09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ50371',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 131303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_d514b617d2b59986cd289efecad5f5b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_265a140087d4150898af4d6a8126dae4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_75f372a7054b5b76faaf3aefaa8ef478.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_caa8cb8461bc5f7b2bc2165400ceae2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b4971d-294a-5961-a0bf-9ede159beb09/71b4971d-294a-5961-a0bf-9ede159beb09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/e1/81e1f6ed93b53e75f17123057f28147f/pa/TJ50371_8cb5d31609bd7a39074e1189653befdf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-04-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2004}
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50371%27 HTTP/1.1" 200 None
2026-03-28 10:38:52 [auto1.de] INFO: Saving data for TJ50371: {'created_time': 1774694332.777912, 'last_price_update_time': 1774694332.777925, 'auction_closing_time': 1774885845.0}
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ50371') HTTP/1.1" 204 0
2026-03-28 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_14b1a134681a0c02cd39d8f8bade0e90.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_1b85f383979e58cf387dbdd793f3fde2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ13405> (referer: https://www.auto1.com/v1/car-details-view/HZ13405/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM10226> (referer: https://www.auto1.com/v1/car-details-view/DM10226/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:38:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf4d990>
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_780a3a45498a2c3e0cfd97711a630707.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_780a3a45498a2c3e0cfd97711a630707.jpg saved to cache
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ee190>
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_7b5273085d2a98324363d0cb01d58148.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_7b5273085d2a98324363d0cb01d58148.jpg saved to cache
2026-03-28 10:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY89611> (referer: https://www.auto1.com/v1/car-details-view/CY89611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5ec10>
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_14b1a134681a0c02cd39d8f8bade0e90.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_14b1a134681a0c02cd39d8f8bade0e90.jpg saved to cache
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabee8150>
2026-03-28 10:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_1b85f383979e58cf387dbdd793f3fde2.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_1b85f383979e58cf387dbdd793f3fde2.jpg saved to cache
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405
2026-03-28 10:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eee8243-4694-54fd-abdc-e9a7f0b65314 with scrape type 1
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_24bbd9c981f50384a5f5ff813917bc1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_24bbd9c981f50384a5f5ff813917bc1a.jpg not downloaded yet
2026-03-28 10:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226
2026-03-28 10:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with scrape type 1
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_20147c768b5afb526cc6699b9fc5a7f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_20147c768b5afb526cc6699b9fc5a7f8.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_7c467ccfe4d935e1bbddf47b65e4a359.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_7c467ccfe4d935e1bbddf47b65e4a359.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_fae507076d49b67597b4bc7cd7a090da.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_fae507076d49b67597b4bc7cd7a090da.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_29b5efd1bb229840ac407366829da6a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_29b5efd1bb229840ac407366829da6a2.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_ae624be375fc79d654cf493331a9ecdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_ae624be375fc79d654cf493331a9ecdd.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_fd8980bf381ada1006502694b7bb7d6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_fd8980bf381ada1006502694b7bb7d6a.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_9aaee25be995a2c6240a5aff0cd3519c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_9aaee25be995a2c6240a5aff0cd3519c.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_2bf5ed0920c7e32533aa4761c394dfb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_2bf5ed0920c7e32533aa4761c394dfb2.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_5ff0b77f842f0e74d2416560d3da54dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_5ff0b77f842f0e74d2416560d3da54dd.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fb9%252F8eb9f4908aebfe97cae21a65c2f8ad72%252Fpa%252FDM10226_8864e3c583d864728dcef163dee1ef53.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_8864e3c583d864728dcef163dee1ef53.jpg already downloaded
2026-03-28 10:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704, identifier: DM10226
2026-03-28 10:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226
2026-03-28 10:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226
2026-03-28 10:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f4d39f2-46b2-5982-b2d2-c8a14d4e5704 with identifier: DM10226 to the API
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DM10226>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:45:50Z',
 'fuel_type': 'petrol',
 'id': '1f4d39f2-46b2-5982-b2d2-c8a14d4e5704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM10226',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 4507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_20147c768b5afb526cc6699b9fc5a7f8.jpg',
                'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_7c467ccfe4d935e1bbddf47b65e4a359.jpg',
                'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_fae507076d49b67597b4bc7cd7a090da.jpg',
                'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_29b5efd1bb229840ac407366829da6a2.jpg',
                'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_ae624be375fc79d654cf493331a9ecdd.jpg',
                'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_fd8980bf381ada1006502694b7bb7d6a.jpg',
                'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_9aaee25be995a2c6240a5aff0cd3519c.jpg',
                'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_2bf5ed0920c7e32533aa4761c394dfb2.jpg',
                'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_5ff0b77f842f0e74d2416560d3da54dd.jpg',
                'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_8864e3c583d864728dcef163dee1ef53.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_20147c768b5afb526cc6699b9fc5a7f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_7c467ccfe4d935e1bbddf47b65e4a359.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_fae507076d49b67597b4bc7cd7a090da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_29b5efd1bb229840ac407366829da6a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_ae624be375fc79d654cf493331a9ecdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_fd8980bf381ada1006502694b7bb7d6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_9aaee25be995a2c6240a5aff0cd3519c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_2bf5ed0920c7e32533aa4761c394dfb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_5ff0b77f842f0e74d2416560d3da54dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f4d39f2-46b2-5982-b2d2-c8a14d4e5704/1f4d39f2-46b2-5982-b2d2-c8a14d4e5704_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/b9/8eb9f4908aebfe97cae21a65c2f8ad72/pa/DM10226_8864e3c583d864728dcef163dee1ef53.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Mokka 1.2 Turbo GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM10226%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [auto1.de] INFO: Saving data for DM10226: {'created_time': 1774694333.867462, 'last_price_update_time': 1774694333.867474, 'auction_closing_time': 1774885550.0}
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM10226') HTTP/1.1" 204 0
2026-03-28 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_e3f66f54e7ea7b84fc35ed648b33d895.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_c6a7bfca8a296dfe7985304edcffc79a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_c6a7bfca8a296dfe7985304edcffc79a.jpg not downloaded yet
2026-03-28 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_6a5d8cd76dcf91c0366b80dc68bf9c2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_07fd1a6773aafe1b98a818e856ef7141.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_d043b6471a5d76fe84b4a2c1ae02937e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_d043b6471a5d76fe84b4a2c1ae02937e.jpg not downloaded yet
2026-03-28 10:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611
2026-03-28 10:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05e63a9c-5207-5003-84cf-f73000dbb885 with scrape type 1
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 05e63a9c-5207-5003-84cf-f73000dbb885
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff8%252F98f8065d48627ff68aa874c5e1dbabe4%252Fpa%252FCY89611_f4c02002b91d680ed49f3def1f9aa686.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_f4c02002b91d680ed49f3def1f9aa686.jpg already downloaded
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff8%252F98f8065d48627ff68aa874c5e1dbabe4%252Fpa%252FCY89611_5ab6d8ae214188656cd552e984a4b3a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_5ab6d8ae214188656cd552e984a4b3a5.jpg already downloaded
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff8%252F98f8065d48627ff68aa874c5e1dbabe4%252Fpa%252FCY89611_0e77486d4c214bffa538c9296d999969.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_0e77486d4c214bffa538c9296d999969.jpg already downloaded
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff8%252F98f8065d48627ff68aa874c5e1dbabe4%252Fpa%252FCY89611_b41b741f12f073fdc88fc4851a9c46eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_b41b741f12f073fdc88fc4851a9c46eb.jpg already downloaded
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Ff8%252F98f8065d48627ff68aa874c5e1dbabe4%252Fpa%252FCY89611_905d2e0e39232d937afbf19c585bedb5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_905d2e0e39232d937afbf19c585bedb5.jpg already downloaded
2026-03-28 10:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05e63a9c-5207-5003-84cf-f73000dbb885, identifier: CY89611
2026-03-28 10:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611
2026-03-28 10:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611
2026-03-28 10:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05e63a9c-5207-5003-84cf-f73000dbb885 with identifier: CY89611 to the API
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CY89611>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:49Z',
 'fuel_type': 'petrol',
 'id': '05e63a9c-5207-5003-84cf-f73000dbb885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY89611',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 140067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_f4c02002b91d680ed49f3def1f9aa686.jpg',
                'https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_5ab6d8ae214188656cd552e984a4b3a5.jpg',
                'https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_0e77486d4c214bffa538c9296d999969.jpg',
                'https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_b41b741f12f073fdc88fc4851a9c46eb.jpg',
                'https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_905d2e0e39232d937afbf19c585bedb5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e63a9c-5207-5003-84cf-f73000dbb885/05e63a9c-5207-5003-84cf-f73000dbb885_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_f4c02002b91d680ed49f3def1f9aa686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e63a9c-5207-5003-84cf-f73000dbb885/05e63a9c-5207-5003-84cf-f73000dbb885_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_5ab6d8ae214188656cd552e984a4b3a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e63a9c-5207-5003-84cf-f73000dbb885/05e63a9c-5207-5003-84cf-f73000dbb885_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_0e77486d4c214bffa538c9296d999969.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e63a9c-5207-5003-84cf-f73000dbb885/05e63a9c-5207-5003-84cf-f73000dbb885_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_b41b741f12f073fdc88fc4851a9c46eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05e63a9c-5207-5003-84cf-f73000dbb885/05e63a9c-5207-5003-84cf-f73000dbb885_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/f8/98f8065d48627ff68aa874c5e1dbabe4/pa/CY89611_905d2e0e39232d937afbf19c585bedb5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY89611%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [auto1.de] INFO: Saving data for CY89611: {'created_time': 1774694334.578788, 'last_price_update_time': 1774694334.578801, 'auction_closing_time': 1774885489.0}
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY89611') HTTP/1.1" 204 0
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_1341809fe890901879eb7b6cd27a1dd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_1341809fe890901879eb7b6cd27a1dd9.jpg not downloaded yet
2026-03-28 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_14ec2742d3e35ee719070cb29582ae68.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd44ad0>
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_e3f66f54e7ea7b84fc35ed648b33d895.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_e3f66f54e7ea7b84fc35ed648b33d895.jpg saved to cache
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd955d0>
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_6a5d8cd76dcf91c0366b80dc68bf9c2d.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_6a5d8cd76dcf91c0366b80dc68bf9c2d.jpg saved to cache
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf67950>
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_07fd1a6773aafe1b98a818e856ef7141.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_07fd1a6773aafe1b98a818e856ef7141.jpg saved to cache
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_24bbd9c981f50384a5f5ff813917bc1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_a393a41e69b0e09fe3be91db58918648.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_a393a41e69b0e09fe3be91db58918648.jpg not downloaded yet
2026-03-28 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_839eaeefea339098a86e48cbbef1b1b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_d7df4123839f2d8a19c718d215f508f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_d7df4123839f2d8a19c718d215f508f3.jpg not downloaded yet
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_bdff8d299a250aa9e6c5b0f1c15c01cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_bdff8d299a250aa9e6c5b0f1c15c01cc.jpg not downloaded yet
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8908810>
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_14ec2742d3e35ee719070cb29582ae68.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_14ec2742d3e35ee719070cb29582ae68.jpg saved to cache
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_c6a7bfca8a296dfe7985304edcffc79a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_ef9c155989023bf2f9dc6acbdf2c47b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_ef9c155989023bf2f9dc6acbdf2c47b6.jpg not downloaded yet
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_5d1ab1824118bd71f24361cde034f945.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_5d1ab1824118bd71f24361cde034f945.jpg not downloaded yet
2026-03-28 10:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_8ebde63220510bf0f59a2ce4dd216d3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdc3c90>
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_24bbd9c981f50384a5f5ff813917bc1a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_24bbd9c981f50384a5f5ff813917bc1a.jpg saved to cache
2026-03-28 10:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a00110>
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_839eaeefea339098a86e48cbbef1b1b6.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_839eaeefea339098a86e48cbbef1b1b6.jpg saved to cache
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_d06039d70c7acf6f27e12d9ea16dc157.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_a92a5a3700503680a7a434099e5f935c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_a92a5a3700503680a7a434099e5f935c.jpg not downloaded yet
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_0ef66aba725a8195c2b0120af8c25dc0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_d043b6471a5d76fe84b4a2c1ae02937e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_a393a41e69b0e09fe3be91db58918648.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd989d0>
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_c6a7bfca8a296dfe7985304edcffc79a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_c6a7bfca8a296dfe7985304edcffc79a.jpg saved to cache
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5fed0>
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_8ebde63220510bf0f59a2ce4dd216d3a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_8ebde63220510bf0f59a2ce4dd216d3a.jpg saved to cache
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a61b10>
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_d06039d70c7acf6f27e12d9ea16dc157.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_d06039d70c7acf6f27e12d9ea16dc157.jpg saved to cache
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd98650>
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_0ef66aba725a8195c2b0120af8c25dc0.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_0ef66aba725a8195c2b0120af8c25dc0.jpg saved to cache
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe153d0>
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_d043b6471a5d76fe84b4a2c1ae02937e.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_d043b6471a5d76fe84b4a2c1ae02937e.jpg saved to cache
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89350d0>
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_a393a41e69b0e09fe3be91db58918648.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_a393a41e69b0e09fe3be91db58918648.jpg saved to cache
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE69038> (referer: https://www.auto1.com/v1/car-details-view/EE69038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA12194> (referer: https://www.auto1.com/v1/car-details-view/PA12194/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_c4bba0b671bacfc89c3606e31b6b244f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_93380ff02bfc8114517bac84b0636bfc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_1341809fe890901879eb7b6cd27a1dd9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_bdff8d299a250aa9e6c5b0f1c15c01cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_909b023b2c2bc1cf9908944c941db520.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_028de27a7e07d4f837b060162b70d8e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038
2026-03-28 10:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with scrape type 1
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_ab326a907df2469882a76ae2974eb2f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_ab326a907df2469882a76ae2974eb2f6.jpg not downloaded yet
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_b9ba07470f01d883009a5acd7241db9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_b9ba07470f01d883009a5acd7241db9c.jpg not downloaded yet
2026-03-28 10:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194
2026-03-28 10:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with scrape type 1
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_8873009ad13d0782a0ceb515bc41c88e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_8873009ad13d0782a0ceb515bc41c88e.jpg not downloaded yet
2026-03-28 10:38:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88e8090>
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_c4bba0b671bacfc89c3606e31b6b244f.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_c4bba0b671bacfc89c3606e31b6b244f.jpg saved to cache
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf70550>
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbc%252Fb0%252Fbcb065b47cb9f0b3e174d9432a24bcb0%252Fpa%252FBB69200_93380ff02bfc8114517bac84b0636bfc.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_93380ff02bfc8114517bac84b0636bfc.jpg saved to cache
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8af5e4f7-661c-539f-ba7c-adb55179fed1
2026-03-28 10:38:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8af5e4f7-661c-539f-ba7c-adb55179fed1, skipping ID generation
2026-03-28 10:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8af5e4f7-661c-539f-ba7c-adb55179fed1 with scrape type 1
2026-03-28 10:38:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8af5e4f7-661c-539f-ba7c-adb55179fed1 sending to next pipeline
2026-03-28 10:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8af5e4f7-661c-539f-ba7c-adb55179fed1, identifier: BB69200
2026-03-28 10:38:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe16f10>
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_1341809fe890901879eb7b6cd27a1dd9.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_1341809fe890901879eb7b6cd27a1dd9.jpg saved to cache
2026-03-28 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe919d0>
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_bdff8d299a250aa9e6c5b0f1c15c01cc.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_bdff8d299a250aa9e6c5b0f1c15c01cc.jpg saved to cache
2026-03-28 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_92c5a9dfd7da6be8c2eae89391891d95.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_92c5a9dfd7da6be8c2eae89391891d95.jpg not downloaded yet
2026-03-28 10:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8af5e4f7-661c-539f-ba7c-adb55179fed1 with identifier: BB69200
2026-03-28 10:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8af5e4f7-661c-539f-ba7c-adb55179fed1 with identifier: BB69200
2026-03-28 10:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8af5e4f7-661c-539f-ba7c-adb55179fed1 with identifier: BB69200 to the API
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_93380ff02bfc8114517bac84b0636bfc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:55:30Z',
 'fuel_type': 'diesel',
 'id': '8af5e4f7-661c-539f-ba7c-adb55179fed1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB69200',
 'listing': 'auction',
 'location': 'DE, Markkleeberg',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 170296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_14ec2742d3e35ee719070cb29582ae68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_7b5273085d2a98324363d0cb01d58148.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_6a5d8cd76dcf91c0366b80dc68bf9c2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2099184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_0ef66aba725a8195c2b0120af8c25dc0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2609675,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_c4bba0b671bacfc89c3606e31b6b244f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_07fd1a6773aafe1b98a818e856ef7141.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_14b1a134681a0c02cd39d8f8bade0e90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_1b85f383979e58cf387dbdd793f3fde2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_e3f66f54e7ea7b84fc35ed648b33d895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8af5e4f7-661c-539f-ba7c-adb55179fed1/8af5e4f7-661c-539f-ba7c-adb55179fed1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2549143,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbc/b0/bcb065b47cb9f0b3e174d9432a24bcb0/pa/BB69200_93380ff02bfc8114517bac84b0636bfc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB69200%27 HTTP/1.1" 200 None
2026-03-28 10:38:56 [auto1.de] INFO: Saving data for BB69200: {'created_time': 1774694336.903995, 'last_price_update_time': 1774694336.904008, 'auction_closing_time': 1774886130.0}
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB69200') HTTP/1.1" 204 0
2026-03-28 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_a92a5a3700503680a7a434099e5f935c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_ab696b68b8212a417004b378eab7d85d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_ab696b68b8212a417004b378eab7d85d.jpg not downloaded yet
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfcb410>
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_909b023b2c2bc1cf9908944c941db520.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_909b023b2c2bc1cf9908944c941db520.jpg saved to cache
2026-03-28 10:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_ef9c155989023bf2f9dc6acbdf2c47b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_d7df4123839f2d8a19c718d215f508f3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_4d53371a6e33a9a41843cdeb6e3b9685.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_4d53371a6e33a9a41843cdeb6e3b9685.jpg not downloaded yet
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_5b5dfa1c862fa80d87beb134951402b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_5b5dfa1c862fa80d87beb134951402b9.jpg not downloaded yet
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeffa10>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_028de27a7e07d4f837b060162b70d8e0.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_028de27a7e07d4f837b060162b70d8e0.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_582c819a49b46df9c5294661e9fdc2bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_582c819a49b46df9c5294661e9fdc2bf.jpg not downloaded yet
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_02a3c2177412ff44ffaacaac3ca565db.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_02a3c2177412ff44ffaacaac3ca565db.jpg not downloaded yet
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_5495e18dc778b17e9b5ba48e857ac460.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_5495e18dc778b17e9b5ba48e857ac460.jpg not downloaded yet
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad7a90>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_a92a5a3700503680a7a434099e5f935c.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_a92a5a3700503680a7a434099e5f935c.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_ba336e27c9a7abbf29e913162ae4ad0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_ba336e27c9a7abbf29e913162ae4ad0b.jpg not downloaded yet
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_92c5a9dfd7da6be8c2eae89391891d95.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_ab326a907df2469882a76ae2974eb2f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_5bdae03572e24dcd10fc0e81ff177615.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_5bdae03572e24dcd10fc0e81ff177615.jpg not downloaded yet
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5cd10>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_ef9c155989023bf2f9dc6acbdf2c47b6.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_ef9c155989023bf2f9dc6acbdf2c47b6.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad2790>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_d7df4123839f2d8a19c718d215f508f3.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_d7df4123839f2d8a19c718d215f508f3.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_1fc828754bd9c31a83dbae9653e3ade3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_85dc87978539b5b596e87ec9575481bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_85dc87978539b5b596e87ec9575481bd.jpg not downloaded yet
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_b9ba07470f01d883009a5acd7241db9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a03990>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_92c5a9dfd7da6be8c2eae89391891d95.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_92c5a9dfd7da6be8c2eae89391891d95.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_4e3c7b8a2554eb23693cf1b16d90d290.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_4e3c7b8a2554eb23693cf1b16d90d290.jpg not downloaded yet
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_ac8c5ab5812ce73322de6957e4e433cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabefcb50>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_ab326a907df2469882a76ae2974eb2f6.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_ab326a907df2469882a76ae2974eb2f6.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_dafffa68ebaec3dcc1b3acc51b736c1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_dafffa68ebaec3dcc1b3acc51b736c1d.jpg not downloaded yet
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_a159337f616b98b312aca4b4b4345e1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_a159337f616b98b312aca4b4b4345e1a.jpg not downloaded yet
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f6f10>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_1fc828754bd9c31a83dbae9653e3ade3.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_1fc828754bd9c31a83dbae9653e3ade3.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f8890>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_b9ba07470f01d883009a5acd7241db9c.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_b9ba07470f01d883009a5acd7241db9c.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_1be1ed629ef6e4a3b36657ba2cbb02ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_2a3bbfa341d3c075133545aefa9be12c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_ba336e27c9a7abbf29e913162ae4ad0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_5495e18dc778b17e9b5ba48e857ac460.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ac8483390>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_ac8c5ab5812ce73322de6957e4e433cb.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_ac8c5ab5812ce73322de6957e4e433cb.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_5d1ab1824118bd71f24361cde034f945.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_a159337f616b98b312aca4b4b4345e1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_aa564c7333466db78a7a43eaa626a0f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_8873009ad13d0782a0ceb515bc41c88e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_88ad8d63776a7c6744ceb93f6b767cbd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5cc50>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_1be1ed629ef6e4a3b36657ba2cbb02ec.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_1be1ed629ef6e4a3b36657ba2cbb02ec.jpg saved to cache
2026-03-28 10:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_02a3c2177412ff44ffaacaac3ca565db.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a7c910>
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252F97%252Fbf97d0983748aaefc88ff26ef603acd9%252Fpa%252FXE92374_2a3bbfa341d3c075133545aefa9be12c.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_2a3bbfa341d3c075133545aefa9be12c.jpg saved to cache
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8c23c2c-e67e-5a29-8050-c0aa11265903
2026-03-28 10:38:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8c23c2c-e67e-5a29-8050-c0aa11265903, skipping ID generation
2026-03-28 10:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c23c2c-e67e-5a29-8050-c0aa11265903 with scrape type 1
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8c23c2c-e67e-5a29-8050-c0aa11265903 sending to next pipeline
2026-03-28 10:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8c23c2c-e67e-5a29-8050-c0aa11265903, identifier: XE92374
2026-03-28 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_582c819a49b46df9c5294661e9fdc2bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_85dc87978539b5b596e87ec9575481bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374
2026-03-28 10:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374
2026-03-28 10:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8c23c2c-e67e-5a29-8050-c0aa11265903 with identifier: XE92374 to the API
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_2a3bbfa341d3c075133545aefa9be12c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 189,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:29:26Z',
 'fuel_type': 'petrol',
 'id': 'c8c23c2c-e67e-5a29-8050-c0aa11265903',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE92374',
 'listing': 'auction',
 'location': 'DE, Düren',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 96383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61383,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_ac8c5ab5812ce73322de6957e4e433cb.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57490,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_2a3bbfa341d3c075133545aefa9be12c.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48897,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_1fc828754bd9c31a83dbae9653e3ade3.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48596,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_909b023b2c2bc1cf9908944c941db520.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58762,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_028de27a7e07d4f837b060162b70d8e0.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55940,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_d06039d70c7acf6f27e12d9ea16dc157.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51430,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_32fa74a4f182b94f1f2e4b08d42ea671.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59719,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_ddc1052bf6ad1647e2841a3b50b0c638.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62655,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_e17c74642421058c0aa7c876459a240b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8c23c2c-e67e-5a29-8050-c0aa11265903/c8c23c2c-e67e-5a29-8050-c0aa11265903_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56751,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/97/bf97d0983748aaefc88ff26ef603acd9/pa/XE92374_3300664262ab894cfab827a1ad9ede1a.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-08-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-28 10:38:58 [auto1.de] INFO: Saving data for XE92374: {'created_time': 1774694338.560635, 'last_price_update_time': 1774694338.560649, 'auction_closing_time': 1774884566.0}
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE92374') HTTP/1.1" 204 0
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ca250>
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_ba336e27c9a7abbf29e913162ae4ad0b.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_ba336e27c9a7abbf29e913162ae4ad0b.jpg saved to cache
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba844650>
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_5495e18dc778b17e9b5ba48e857ac460.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_5495e18dc778b17e9b5ba48e857ac460.jpg saved to cache
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48
2026-03-28 10:38:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaacf1d0>
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fcd%252F99cd2440289e8873d165492b9964caed%252Fpa%252FHZ13405_5d1ab1824118bd71f24361cde034f945.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_5d1ab1824118bd71f24361cde034f945.jpg saved to cache
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3eee8243-4694-54fd-abdc-e9a7f0b65314
2026-03-28 10:38:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3eee8243-4694-54fd-abdc-e9a7f0b65314, skipping ID generation
2026-03-28 10:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eee8243-4694-54fd-abdc-e9a7f0b65314 with scrape type 1
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3eee8243-4694-54fd-abdc-e9a7f0b65314 sending to next pipeline
2026-03-28 10:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3eee8243-4694-54fd-abdc-e9a7f0b65314, identifier: HZ13405
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd0d2d0>
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_a159337f616b98b312aca4b4b4345e1a.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_a159337f616b98b312aca4b4b4345e1a.jpg saved to cache
2026-03-28 10:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:38:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabee0210>
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_aa564c7333466db78a7a43eaa626a0f2.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_aa564c7333466db78a7a43eaa626a0f2.jpg saved to cache
2026-03-28 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda0ad0>
2026-03-28 10:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_8873009ad13d0782a0ceb515bc41c88e.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_8873009ad13d0782a0ceb515bc41c88e.jpg saved to cache
2026-03-28 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:38:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab96d5650>
2026-03-28 10:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F9b%252F7f9b536a0ef755b07a4e7092e3265d79%252Fpa%252FAD84103_88ad8d63776a7c6744ceb93f6b767cbd.jpg') HTTP/1.1" 204 0
2026-03-28 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_88ad8d63776a7c6744ceb93f6b767cbd.jpg saved to cache
2026-03-28 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1609c20e-b5f6-584f-a876-6176ac2bfe54
2026-03-28 10:38:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1609c20e-b5f6-584f-a876-6176ac2bfe54, skipping ID generation
2026-03-28 10:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1609c20e-b5f6-584f-a876-6176ac2bfe54 with scrape type 1
2026-03-28 10:38:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1609c20e-b5f6-584f-a876-6176ac2bfe54 sending to next pipeline
2026-03-28 10:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1609c20e-b5f6-584f-a876-6176ac2bfe54, identifier: AD84103
2026-03-28 10:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_4e3c7b8a2554eb23693cf1b16d90d290.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405
2026-03-28 10:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405
2026-03-28 10:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3eee8243-4694-54fd-abdc-e9a7f0b65314 with identifier: HZ13405 to the API
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_5d1ab1824118bd71f24361cde034f945.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:29:56Z',
 'fuel_type': 'diesel',
 'id': '3eee8243-4694-54fd-abdc-e9a7f0b65314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ13405',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 168380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_24bbd9c981f50384a5f5ff813917bc1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_c6a7bfca8a296dfe7985304edcffc79a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_d043b6471a5d76fe84b4a2c1ae02937e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2767904,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_1341809fe890901879eb7b6cd27a1dd9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69178,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_a393a41e69b0e09fe3be91db58918648.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_d7df4123839f2d8a19c718d215f508f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2789947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_bdff8d299a250aa9e6c5b0f1c15c01cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_ef9c155989023bf2f9dc6acbdf2c47b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_5d1ab1824118bd71f24361cde034f945.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3eee8243-4694-54fd-abdc-e9a7f0b65314/3eee8243-4694-54fd-abdc-e9a7f0b65314_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/cd/99cd2440289e8873d165492b9964caed/pa/HZ13405_a92a5a3700503680a7a434099e5f935c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
 'transmission': 'automatic',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13405%27 HTTP/1.1" 200 None
2026-03-28 10:38:59 [auto1.de] INFO: Saving data for HZ13405: {'created_time': 1774694339.786667, 'last_price_update_time': 1774694339.786679, 'auction_closing_time': 1774884596.0}
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ13405') HTTP/1.1" 204 0
2026-03-28 10:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103
2026-03-28 10:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103
2026-03-28 10:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1609c20e-b5f6-584f-a876-6176ac2bfe54 with identifier: AD84103 to the API
2026-03-28 10:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_88ad8d63776a7c6744ceb93f6b767cbd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:59Z',
 'fuel_type': 'petrol',
 'id': '1609c20e-b5f6-584f-a876-6176ac2bfe54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD84103',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 86235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3066354,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_be62e7f5a59f26eae2f770f21778f19f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3142659,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_88ad8d63776a7c6744ceb93f6b767cbd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3173339,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_2507969b3ca9b61a906f35540f2b99ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2990136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_1be1ed629ef6e4a3b36657ba2cbb02ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3115590,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_aa564c7333466db78a7a43eaa626a0f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3181236,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_8ebde63220510bf0f59a2ce4dd216d3a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2920047,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_839eaeefea339098a86e48cbbef1b1b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3210964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_780a3a45498a2c3e0cfd97711a630707.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_aa806414671cbd69f067839ecb960d5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1609c20e-b5f6-584f-a876-6176ac2bfe54/1609c20e-b5f6-584f-a876-6176ac2bfe54_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2651446,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/9b/7f9b536a0ef755b07a4e7092e3265d79/pa/AD84103_afc4143528d46942f2205bcb138e463c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2018}
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD84103%27 HTTP/1.1" 200 None
2026-03-28 10:39:00 [auto1.de] INFO: Saving data for AD84103: {'created_time': 1774694340.231013, 'last_price_update_time': 1774694340.231026, 'auction_closing_time': 1774884539.0}
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD84103') HTTP/1.1" 204 0
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd77dd0>
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_02a3c2177412ff44ffaacaac3ca565db.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_02a3c2177412ff44ffaacaac3ca565db.jpg saved to cache
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc0bad0>
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_582c819a49b46df9c5294661e9fdc2bf.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_582c819a49b46df9c5294661e9fdc2bf.jpg saved to cache
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88f80d0>
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_85dc87978539b5b596e87ec9575481bd.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_85dc87978539b5b596e87ec9575481bd.jpg saved to cache
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:39:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.600(s), this was the 1st time calling it.
2026-03-28 10:39:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.7763066472063738 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:39:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.601(s), this was the 1st time calling it.
2026-03-28 10:39:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.4524667363536814 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ac6f7d350>
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_4e3c7b8a2554eb23693cf1b16d90d290.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_4e3c7b8a2554eb23693cf1b16d90d290.jpg saved to cache
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_5bdae03572e24dcd10fc0e81ff177615.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_dafffa68ebaec3dcc1b3acc51b736c1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_4d53371a6e33a9a41843cdeb6e3b9685.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_ab696b68b8212a417004b378eab7d85d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_253d42adaec76203a351e328b3d39e5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe43dd0>
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_5bdae03572e24dcd10fc0e81ff177615.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_5bdae03572e24dcd10fc0e81ff177615.jpg saved to cache
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_7ceb71510b2b5dfe2e142b1e6e8cf358.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd77ad0>
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_dafffa68ebaec3dcc1b3acc51b736c1d.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_dafffa68ebaec3dcc1b3acc51b736c1d.jpg saved to cache
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd422d0>
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F83%252F4f83bba530449174a58a4d52dc418ddd%252Fpa%252FEE69038_4d53371a6e33a9a41843cdeb6e3b9685.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_4d53371a6e33a9a41843cdeb6e3b9685.jpg saved to cache
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48
2026-03-28 10:39:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48, skipping ID generation
2026-03-28 10:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with scrape type 1
2026-03-28 10:39:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 sending to next pipeline
2026-03-28 10:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48, identifier: EE69038
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeeaf10>
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_ab696b68b8212a417004b378eab7d85d.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_ab696b68b8212a417004b378eab7d85d.jpg saved to cache
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed7ed0>
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_253d42adaec76203a351e328b3d39e5e.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_253d42adaec76203a351e328b3d39e5e.jpg saved to cache
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038
2026-03-28 10:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038
2026-03-28 10:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48 with identifier: EE69038 to the API
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_4d53371a6e33a9a41843cdeb6e3b9685.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'petrol',
 'id': 'f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE69038',
 'listing': 'auction',
 'location': 'DE, Halle',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 154555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81307,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_ab326a907df2469882a76ae2974eb2f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_b9ba07470f01d883009a5acd7241db9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_92c5a9dfd7da6be8c2eae89391891d95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_4d53371a6e33a9a41843cdeb6e3b9685.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103265,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_582c819a49b46df9c5294661e9fdc2bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48/f7bcbbb0-1ab1-5162-bd73-5a329ff5cc48_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/83/4f83bba530449174a58a4d52dc418ddd/pa/EE69038_5495e18dc778b17e9b5ba48e857ac460.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 MyLife',
 'transmission': 'manual',
 'trim': 'MyLife',
 'year': 2011}
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE69038%27 HTTP/1.1" 200 None
2026-03-28 10:39:01 [auto1.de] INFO: Saving data for EE69038: {'created_time': 1774694341.497831, 'last_price_update_time': 1774694341.497845, 'auction_closing_time': 1774882938.0}
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE69038') HTTP/1.1" 204 0
2026-03-28 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_f0249e1d8f14870d7bb3bf7cef67bbc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfd1250>
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_7ceb71510b2b5dfe2e142b1e6e8cf358.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_7ceb71510b2b5dfe2e142b1e6e8cf358.jpg saved to cache
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_5b5dfa1c862fa80d87beb134951402b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_af5846fe8d748ba73b295695ec167afe.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_908a0761ca68f323ef17442e8af47d70.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_0b2bb2428ce9dde391400992d197f587.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab891bf10>
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_f0249e1d8f14870d7bb3bf7cef67bbc5.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_f0249e1d8f14870d7bb3bf7cef67bbc5.jpg saved to cache
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d
2026-03-28 10:39:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc0b610>
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F19%252F5c197d84b346774724d5a712d43d0dd1%252Fpa%252FPA12194_5b5dfa1c862fa80d87beb134951402b9.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_5b5dfa1c862fa80d87beb134951402b9.jpg saved to cache
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545
2026-03-28 10:39:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545, skipping ID generation
2026-03-28 10:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with scrape type 1
2026-03-28 10:39:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 sending to next pipeline
2026-03-28 10:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545, identifier: PA12194
2026-03-28 10:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194
2026-03-28 10:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194
2026-03-28 10:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14b4fa88-bc89-5d07-aaf1-cba3ce7bc545 with identifier: PA12194 to the API
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_5b5dfa1c862fa80d87beb134951402b9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:41:24Z',
 'fuel_type': 'petrol',
 'id': '14b4fa88-bc89-5d07-aaf1-cba3ce7bc545',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA12194',
 'listing': 'auction',
 'location': 'DE, Bocholt',
 'make': 'BMW',
 'model': '3er',
 'odometer': 88046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992500,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_8873009ad13d0782a0ceb515bc41c88e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_ab696b68b8212a417004b378eab7d85d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3021011,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_5b5dfa1c862fa80d87beb134951402b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_02a3c2177412ff44ffaacaac3ca565db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_ba336e27c9a7abbf29e913162ae4ad0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2982120,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_5bdae03572e24dcd10fc0e81ff177615.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_85dc87978539b5b596e87ec9575481bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_4e3c7b8a2554eb23693cf1b16d90d290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3016136,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_dafffa68ebaec3dcc1b3acc51b736c1d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14b4fa88-bc89-5d07-aaf1-cba3ce7bc545/14b4fa88-bc89-5d07-aaf1-cba3ce7bc545_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/19/5c197d84b346774724d5a712d43d0dd1/pa/PA12194_a159337f616b98b312aca4b4b4345e1a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA12194%27 HTTP/1.1" 200 None
2026-03-28 10:39:02 [auto1.de] INFO: Saving data for PA12194: {'created_time': 1774694342.309507, 'last_price_update_time': 1774694342.309519, 'auction_closing_time': 1774885284.0}
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA12194') HTTP/1.1" 204 0
2026-03-28 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_dbf477035d70cee5e1b2c0d3b0288497.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_888fa0506797c4732d3cada64c987f2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY14416> (referer: https://www.auto1.com/v1/car-details-view/PY14416/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY64199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb1590>
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_af5846fe8d748ba73b295695ec167afe.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_af5846fe8d748ba73b295695ec167afe.jpg saved to cache
2026-03-28 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:39:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfd1790>
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fba%252F53ba629405fbfa52d01825957ff06275%252Fpa%252FUB66562_908a0761ca68f323ef17442e8af47d70.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_908a0761ca68f323ef17442e8af47d70.jpg saved to cache
2026-03-28 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed
2026-03-28 10:39:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed, skipping ID generation
2026-03-28 10:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with scrape type 1
2026-03-28 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed sending to next pipeline
2026-03-28 10:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed, identifier: UB66562
2026-03-28 10:39:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe1d290>
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fbf%252F19bfd6ae09fe4941c31f79d30fe6886a%252Fpa%252FLX44847_0b2bb2428ce9dde391400992d197f587.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_0b2bb2428ce9dde391400992d197f587.jpg saved to cache
2026-03-28 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5b185f9-2494-5a2f-b23c-65840b646c05
2026-03-28 10:39:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5b185f9-2494-5a2f-b23c-65840b646c05, skipping ID generation
2026-03-28 10:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b185f9-2494-5a2f-b23c-65840b646c05 with scrape type 1
2026-03-28 10:39:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5b185f9-2494-5a2f-b23c-65840b646c05 sending to next pipeline
2026-03-28 10:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5b185f9-2494-5a2f-b23c-65840b646c05, identifier: LX44847
2026-03-28 10:39:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562
2026-03-28 10:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562
2026-03-28 10:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed with identifier: UB66562 to the API
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_908a0761ca68f323ef17442e8af47d70.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:04:09Z',
 'fuel_type': 'diesel',
 'id': 'cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB66562',
 'listing': 'auction',
 'location': 'DE, Passau',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 202966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2741990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_8c87858acfe64754dbdb41c470ea9574.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2502998,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_908a0761ca68f323ef17442e8af47d70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2493541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_af5846fe8d748ba73b295695ec167afe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_7ceb71510b2b5dfe2e142b1e6e8cf358.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660252,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_b7b8936675883037fbcd7636955ddcb1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545342,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_6fa31638a7d288b1f9f267103a2c8f62.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2435880,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_92cb0d025b8718a10360f2e67581a170.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_a6a27aa228b435ea69c8fac646b35dcb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790232,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_a32dba382065b6dc16bd2fbc36a714ac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed/cf3e6d45-ad9d-5d8a-9efa-1c5d0e52c3ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/ba/53ba629405fbfa52d01825957ff06275/pa/UB66562_134396ca0c744abd703876dbbed82c3c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 130',
 'transmission': 'manual',
 'trim': '130',
 'year': 2017}
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB66562%27 HTTP/1.1" 200 None
2026-03-28 10:39:03 [auto1.de] INFO: Saving data for UB66562: {'created_time': 1774694343.367679, 'last_price_update_time': 1774694343.367691, 'auction_closing_time': 1774883049.0}
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB66562') HTTP/1.1" 204 0
2026-03-28 10:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847
2026-03-28 10:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847
2026-03-28 10:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5b185f9-2494-5a2f-b23c-65840b646c05 with identifier: LX44847 to the API
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_0b2bb2428ce9dde391400992d197f587.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:50Z',
 'fuel_type': 'diesel',
 'id': 'a5b185f9-2494-5a2f-b23c-65840b646c05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX44847',
 'listing': 'auction',
 'location': 'DE, Seevetal',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 194225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_253d42adaec76203a351e328b3d39e5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2877033,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_0b2bb2428ce9dde391400992d197f587.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629955,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_1f261bda0bf17e27b0b23d49afb4e3fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_f5d6ec3531d75fa14c681a87d59f01e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_9cf9344ec9e6f83ec78184af9e1c5201.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_c7256dd437515264fc670cef1f4f77db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2123452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_0b6400d4d06c909a5d090d75ca83d7a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2205628,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_896919132f1c682c08b16229b2896e52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2775078,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_bea0ae09ee107b0f2e9df7dd67d1e805.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b185f9-2494-5a2f-b23c-65840b646c05/a5b185f9-2494-5a2f-b23c-65840b646c05_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/bf/19bfd6ae09fe4941c31f79d30fe6886a/pa/LX44847_313d8446e4ec1646c7a214bad415ba34.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44847%27 HTTP/1.1" 200 None
2026-03-28 10:39:03 [auto1.de] INFO: Saving data for LX44847: {'created_time': 1774694343.77001, 'last_price_update_time': 1774694343.770021, 'auction_closing_time': 1774882850.0}
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX44847') HTTP/1.1" 204 0
2026-03-28 10:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed5490>
2026-03-28 10:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_dbf477035d70cee5e1b2c0d3b0288497.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_dbf477035d70cee5e1b2c0d3b0288497.jpg saved to cache
2026-03-28 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb5250>
2026-03-28 10:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_888fa0506797c4732d3cada64c987f2a.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_888fa0506797c4732d3cada64c987f2a.jpg saved to cache
2026-03-28 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:39:03 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 9638 | hits on page: 40
2026-03-28 10:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416
2026-03-28 10:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with scrape type 1
2026-03-28 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_4c0e6a84647dca1ecb01f48421ca97b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_4c0e6a84647dca1ecb01f48421ca97b3.jpg not downloaded yet
2026-03-28 10:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XN06908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:03 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-28 10:39:03 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-28 10:39:03 [auto1.de] INFO: Scrape type for GG20866: 0
2026-03-28 10:39:03 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-28 10:39:03 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-28 10:39:03 [auto1.de] INFO: Scrape type for WY65265: 0
2026-03-28 10:39:03 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-28 10:39:03 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-28 10:39:03 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-28 10:39:03 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-28 10:39:03 [auto1.de] INFO: Scrape type for RV78416: 2
2026-03-28 10:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416
2026-03-28 10:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebc1933d-86f1-53b4-94d6-a65785ebb8db with scrape type 2
2026-03-28 10:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebc1933d-86f1-53b4-94d6-a65785ebb8db with scrape type 2
2026-03-28 10:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebc1933d-86f1-53b4-94d6-a65785ebb8db, identifier: RV78416
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_916bf1102431a013fb1a77ff8b7013c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_916bf1102431a013fb1a77ff8b7013c2.jpg not downloaded yet
2026-03-28 10:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416
2026-03-28 10:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416
2026-03-28 10:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebc1933d-86f1-53b4-94d6-a65785ebb8db with identifier: RV78416 to the API
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:30:05Z',
 'fuel_type': 'petrol',
 'id': 'ebc1933d-86f1-53b4-94d6-a65785ebb8db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV78416',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 138027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-03',
 'seller_name': None,
 'title': "Kia cee'd 1.6 GDI Dream-Team",
 'transmission': 'manual',
 'trim': 'Dream-Team',
 'year': 2018}
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-28 10:39:04 [auto1.de] INFO: Saving data for RV78416: {'auction_closing_time': 1774884605.0, 'created_time': 1773382621.812883, 'last_price_update_time': 1774694344.467977}
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV78416') HTTP/1.1" 204 0
2026-03-28 10:39:04 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-28 10:39:04 [auto1.de] INFO: Scrape type for GB67844: 2
2026-03-28 10:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844
2026-03-28 10:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with scrape type 2
2026-03-28 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with scrape type 2
2026-03-28 10:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4, identifier: GB67844
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_77d2cad353090b6b2f3f79da647e83d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_77d2cad353090b6b2f3f79da647e83d5.jpg not downloaded yet
2026-03-28 10:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844
2026-03-28 10:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844
2026-03-28 10:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4 with identifier: GB67844 to the API
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'petrol',
 'id': 'eb3710cd-4dd0-5ef4-9a19-c67ccb0f66f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB67844',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 97563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-28',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-28 10:39:05 [auto1.de] INFO: Saving data for GB67844: {'auction_closing_time': 1774883122.0, 'created_time': 1774002058.622467, 'last_price_update_time': 1774694345.09012}
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB67844') HTTP/1.1" 204 0
2026-03-28 10:39:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:39:05 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-28 10:39:05 [auto1.de] INFO: Scrape type for GJ08958: 1
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_47784c8bc4580eac8856fef37078378c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_47784c8bc4580eac8856fef37078378c.jpg not downloaded yet
2026-03-28 10:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_b775adbdd551a9dfa9505ae074b4b3ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_fd026a3dba1fb88b3221ad9a1229e918.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_4c0e6a84647dca1ecb01f48421ca97b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_9502398b1ac3af6134e26cfc9c68835e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:05 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-28 10:39:05 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-28 10:39:05 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-28 10:39:05 [auto1.de] INFO: Scrape type for ZD45339: 2
2026-03-28 10:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339
2026-03-28 10:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03910b3f-6d25-54b0-8e59-b551a22382ca with scrape type 2
2026-03-28 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03910b3f-6d25-54b0-8e59-b551a22382ca with scrape type 2
2026-03-28 10:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03910b3f-6d25-54b0-8e59-b551a22382ca, identifier: ZD45339
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_3d20cd00c55a64801d68a31d952118f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_3d20cd00c55a64801d68a31d952118f1.jpg not downloaded yet
2026-03-28 10:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339
2026-03-28 10:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339
2026-03-28 10:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03910b3f-6d25-54b0-8e59-b551a22382ca with identifier: ZD45339 to the API
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:44:03Z',
 'fuel_type': 'diesel',
 'id': '03910b3f-6d25-54b0-8e59-b551a22382ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD45339',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 54260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-28 10:39:05 [auto1.de] INFO: Saving data for ZD45339: {'auction_closing_time': 1774885443.0, 'created_time': 1773429665.54088, 'last_price_update_time': 1774694345.695449}
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD45339') HTTP/1.1" 204 0
2026-03-28 10:39:05 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-28 10:39:05 [auto1.de] INFO: Scrape type for BU26829: 2
2026-03-28 10:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829
2026-03-28 10:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with scrape type 2
2026-03-28 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with scrape type 2
2026-03-28 10:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9, identifier: BU26829
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_07ff3353a18dad50cab0abada6923786.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_07ff3353a18dad50cab0abada6923786.jpg not downloaded yet
2026-03-28 10:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829
2026-03-28 10:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829
2026-03-28 10:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 211e999d-a1e4-5dca-86fe-7f2790d3eaf9 with identifier: BU26829 to the API
2026-03-28 10:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:53Z',
 'fuel_type': 'diesel',
 'id': '211e999d-a1e4-5dca-86fe-7f2790d3eaf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU26829',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 114186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Match 4Motion',
 'transmission': 'manual',
 'trim': 'Match 4Motion',
 'year': 2012}
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-28 10:39:06 [auto1.de] INFO: Saving data for BU26829: {'auction_closing_time': 1774884473.0, 'created_time': 1774034010.275338, 'last_price_update_time': 1774694346.229021}
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU26829') HTTP/1.1" 204 0
2026-03-28 10:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_47784c8bc4580eac8856fef37078378c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:06 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-28 10:39:06 [auto1.de] INFO: Scrape type for UL74029: 2
2026-03-28 10:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029
2026-03-28 10:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da197803-6d7a-5b47-a9f6-7fad77b4a4cb with scrape type 2
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da197803-6d7a-5b47-a9f6-7fad77b4a4cb with scrape type 2
2026-03-28 10:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da197803-6d7a-5b47-a9f6-7fad77b4a4cb, identifier: UL74029
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf61910>
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_b775adbdd551a9dfa9505ae074b4b3ff.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_b775adbdd551a9dfa9505ae074b4b3ff.jpg saved to cache
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88f8890>
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_fd026a3dba1fb88b3221ad9a1229e918.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_fd026a3dba1fb88b3221ad9a1229e918.jpg saved to cache
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 83a13b29-1f3b-5e38-82de-d63f81df926d
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe53790>
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_4c0e6a84647dca1ecb01f48421ca97b3.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_4c0e6a84647dca1ecb01f48421ca97b3.jpg saved to cache
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe17090>
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Ff0%252Ff2f0c4284bf503bc21e0ed32be7b53b3%252Fpa%252FFX32904_9502398b1ac3af6134e26cfc9c68835e.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_9502398b1ac3af6134e26cfc9c68835e.jpg saved to cache
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 83a13b29-1f3b-5e38-82de-d63f81df926d
2026-03-28 10:39:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 83a13b29-1f3b-5e38-82de-d63f81df926d, skipping ID generation
2026-03-28 10:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83a13b29-1f3b-5e38-82de-d63f81df926d with scrape type 1
2026-03-28 10:39:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 83a13b29-1f3b-5e38-82de-d63f81df926d sending to next pipeline
2026-03-28 10:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83a13b29-1f3b-5e38-82de-d63f81df926d, identifier: FX32904
2026-03-28 10:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_77d2cad353090b6b2f3f79da647e83d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:06 [scrapy.extensions.logstats] INFO: Crawled 127 pages (at 48 pages/min), scraped 92 items (at 28 items/min)
2026-03-28 10:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 185MiB
2026-03-28 10:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029
2026-03-28 10:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029
2026-03-28 10:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da197803-6d7a-5b47-a9f6-7fad77b4a4cb with identifier: UL74029 to the API
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'diesel',
 'id': 'da197803-6d7a-5b47-a9f6-7fad77b4a4cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL74029',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 142197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-04',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-28 10:39:07 [auto1.de] INFO: Saving data for UL74029: {'auction_closing_time': 1774884897.0, 'created_time': 1774032381.296751, 'last_price_update_time': 1774694347.069422}
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL74029') HTTP/1.1" 204 0
2026-03-28 10:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904
2026-03-28 10:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904
2026-03-28 10:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83a13b29-1f3b-5e38-82de-d63f81df926d with identifier: FX32904 to the API
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_9502398b1ac3af6134e26cfc9c68835e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:10:55Z',
 'fuel_type': 'petrol',
 'id': '83a13b29-1f3b-5e38-82de-d63f81df926d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX32904',
 'listing': 'auction',
 'location': 'DE, Friedrichsdorf',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 122294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_a928da2b3d7017a71dd15c3878ec240e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_9502398b1ac3af6134e26cfc9c68835e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_fd026a3dba1fb88b3221ad9a1229e918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_9836ef0648e8b495d5a8d1e83f1d718e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_83a13b29-1f3b-5e38-82de-d63f81df926d/83a13b29-1f3b-5e38-82de-d63f81df926d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/f0/f2f0c4284bf503bc21e0ed32be7b53b3/pa/FX32904_6409671c0b326dce4744fb5f35bcf81b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2004}
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32904%27 HTTP/1.1" 200 None
2026-03-28 10:39:07 [auto1.de] INFO: Saving data for FX32904: {'created_time': 1774694347.458179, 'last_price_update_time': 1774694347.45819, 'auction_closing_time': 1774883455.0}
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX32904') HTTP/1.1" 204 0
2026-03-28 10:39:07 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-28 10:39:07 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-28 10:39:07 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-28 10:39:07 [auto1.de] INFO: Scrape type for MF41650: 1
2026-03-28 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb0250>
2026-03-28 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_47784c8bc4580eac8856fef37078378c.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_47784c8bc4580eac8856fef37078378c.jpg saved to cache
2026-03-28 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970
2026-03-28 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_07ff3353a18dad50cab0abada6923786.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:07 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-28 10:39:07 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-28 10:39:07 [auto1.de] INFO: Scrape type for NV71817: 1
2026-03-28 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM10522/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF54285> (referer: https://www.auto1.com/v1/car-details-view/GF54285/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU85035/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM74850> (referer: https://www.auto1.com/v1/car-details-view/JM74850/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY64199> (referer: https://www.auto1.com/v1/car-details-view/SY64199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd26910>
2026-03-28 10:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_77d2cad353090b6b2f3f79da647e83d5.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_77d2cad353090b6b2f3f79da647e83d5.jpg saved to cache
2026-03-28 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970
2026-03-28 10:39:07 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-28 10:39:07 [auto1.de] INFO: Scrape type for TG89658: 2
2026-03-28 10:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658
2026-03-28 10:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with scrape type 2
2026-03-28 10:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with scrape type 2
2026-03-28 10:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c7dcc5f-6c84-569a-8caa-2acd112040b4, identifier: TG89658
2026-03-28 10:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658
2026-03-28 10:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658
2026-03-28 10:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c7dcc5f-6c84-569a-8caa-2acd112040b4 with identifier: TG89658 to the API
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:14:28Z',
 'fuel_type': 'petrol',
 'id': '8c7dcc5f-6c84-569a-8caa-2acd112040b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG89658',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 134532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-12',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [auto1.de] INFO: Saving data for TG89658: {'auction_closing_time': 1774883668.0, 'created_time': 1773383033.276909, 'last_price_update_time': 1774694348.106596}
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG89658') HTTP/1.1" 204 0
2026-03-28 10:39:08 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [auto1.de] INFO: Scrape type for GA70819: 1
2026-03-28 10:39:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.431(s), this was the 1st time calling it.
2026-03-28 10:39:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 3.378539567432214 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_3d20cd00c55a64801d68a31d952118f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_7db4949632dbaf4447fde8fed8081495.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_7f9a455e786ecb903259fc1c487311b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_916bf1102431a013fb1a77ff8b7013c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:08 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-28 10:39:08 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [auto1.de] INFO: Scrape type for BW55074: 1
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe15110>
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_07ff3353a18dad50cab0abada6923786.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_07ff3353a18dad50cab0abada6923786.jpg saved to cache
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970
2026-03-28 10:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285
2026-03-28 10:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f338615-b78e-533c-a800-4bc3378e5914 with scrape type 1
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_a9c99f62c5f82357b4145430ba55da75.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_a9c99f62c5f82357b4145430ba55da75.jpg not downloaded yet
2026-03-28 10:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850
2026-03-28 10:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3eb70cd-2042-5bf9-90f8-52567c64b389 with scrape type 1
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_42d30f7b9aa95a93c6c6d4237dbb521b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_42d30f7b9aa95a93c6c6d4237dbb521b.jpg not downloaded yet
2026-03-28 10:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199
2026-03-28 10:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc5a3a0-9801-53af-970f-10ff26ba3835 with scrape type 1
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7fc5a3a0-9801-53af-970f-10ff26ba3835
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_63f73e03111ac1771da8fc3a10bb9718.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_63f73e03111ac1771da8fc3a10bb9718.jpg not downloaded yet
2026-03-28 10:39:08 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-28 10:39:08 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [auto1.de] INFO: Scrape type for XE90423: 1
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_d2930acddd9dd742ac376facd9c23a5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_d2930acddd9dd742ac376facd9c23a5b.jpg not downloaded yet
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_20b5a681ceca29535e60915b75b9b8ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_20b5a681ceca29535e60915b75b9b8ef.jpg not downloaded yet
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_6ed1fbce656468c1f1ef22a951056417.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_6ed1fbce656468c1f1ef22a951056417.jpg not downloaded yet
2026-03-28 10:39:08 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [auto1.de] INFO: Scrape type for SK80695: 1
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_8a075cc4a7fe9f5423ce0ca349ca0786.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_8a075cc4a7fe9f5423ce0ca349ca0786.jpg not downloaded yet
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_183a298b095f5b07373a935e6ed1a190.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_183a298b095f5b07373a935e6ed1a190.jpg not downloaded yet
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_4821baa638c69975eb5a28fad830d428.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_4821baa638c69975eb5a28fad830d428.jpg not downloaded yet
2026-03-28 10:39:08 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-28 10:39:08 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [auto1.de] INFO: Scrape type for XV72554: 1
2026-03-28 10:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DM55805/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf61b10>
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_3d20cd00c55a64801d68a31d952118f1.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_3d20cd00c55a64801d68a31d952118f1.jpg saved to cache
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabee8b50>
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_7db4949632dbaf4447fde8fed8081495.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_7db4949632dbaf4447fde8fed8081495.jpg saved to cache
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfd0890>
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb5%252Fce%252Fb5ce475ee56b673518178e52ff5ebc61%252Fpa%252FCN24608_7f9a455e786ecb903259fc1c487311b4.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_7f9a455e786ecb903259fc1c487311b4.jpg saved to cache
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d
2026-03-28 10:39:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d, skipping ID generation
2026-03-28 10:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with scrape type 1
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d sending to next pipeline
2026-03-28 10:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d, identifier: CN24608
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5e2d0>
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg39%252F0a%252F390a21d5e64dea63aa57ee56e1114c74%252Fpa%252FPY14416_916bf1102431a013fb1a77ff8b7013c2.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_916bf1102431a013fb1a77ff8b7013c2.jpg saved to cache
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970
2026-03-28 10:39:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970, skipping ID generation
2026-03-28 10:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with scrape type 1
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 sending to next pipeline
2026-03-28 10:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970, identifier: PY14416
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_e2dbf58fc648a0e18840634e661ac327.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_e2dbf58fc648a0e18840634e661ac327.jpg not downloaded yet
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_4465e5bdf511e5b8e1c84a1b35bfc3fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_4465e5bdf511e5b8e1c84a1b35bfc3fc.jpg not downloaded yet
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_2b810f71a484cf0758e4344538949eb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_2b810f71a484cf0758e4344538949eb7.jpg not downloaded yet
2026-03-28 10:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608
2026-03-28 10:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608
2026-03-28 10:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d with identifier: CN24608 to the API
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_7f9a455e786ecb903259fc1c487311b4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:54Z',
 'fuel_type': 'diesel',
 'id': '30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN24608',
 'listing': 'auction',
 'location': 'DE, Aachen',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 276222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_7db4949632dbaf4447fde8fed8081495.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_7f9a455e786ecb903259fc1c487311b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_b775adbdd551a9dfa9505ae074b4b3ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_f0249e1d8f14870d7bb3bf7cef67bbc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d/30f6f8ff-ea50-5377-a5e3-0aab6e3dda7d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb5/ce/b5ce475ee56b673518178e52ff5ebc61/pa/CN24608_b66f83f2aa5b305a12c3ea504cdfe5be.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 2.2 CTDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2008}
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN24608%27 HTTP/1.1" 200 None
2026-03-28 10:39:09 [auto1.de] INFO: Saving data for CN24608: {'created_time': 1774694349.374981, 'last_price_update_time': 1774694349.374992, 'auction_closing_time': 1774885914.0}
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN24608') HTTP/1.1" 204 0
2026-03-28 10:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416
2026-03-28 10:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416
2026-03-28 10:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f3ab19c-7ba2-5bf8-9f71-95a03e60f970 with identifier: PY14416 to the API
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_916bf1102431a013fb1a77ff8b7013c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:23:24Z',
 'fuel_type': 'petrol',
 'id': '0f3ab19c-7ba2-5bf8-9f71-95a03e60f970',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY14416',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 162831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_4c0e6a84647dca1ecb01f48421ca97b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_916bf1102431a013fb1a77ff8b7013c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64263,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_77d2cad353090b6b2f3f79da647e83d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_47784c8bc4580eac8856fef37078378c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_3d20cd00c55a64801d68a31d952118f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0f3ab19c-7ba2-5bf8-9f71-95a03e60f970/0f3ab19c-7ba2-5bf8-9f71-95a03e60f970_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img39/0a/390a21d5e64dea63aa57ee56e1114c74/pa/PY14416_07ff3353a18dad50cab0abada6923786.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY14416%27 HTTP/1.1" 200 None
2026-03-28 10:39:09 [auto1.de] INFO: Saving data for PY14416: {'created_time': 1774694349.809742, 'last_price_update_time': 1774694349.809751, 'auction_closing_time': 1774884204.0}
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY14416') HTTP/1.1" 204 0
2026-03-28 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_63f73e03111ac1771da8fc3a10bb9718.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:09 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-28 10:39:09 [auto1.de] INFO: Scrape type for DU93693: 1
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_94b611a4b611180877e5cf37da6fd6ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_94b611a4b611180877e5cf37da6fd6ec.jpg not downloaded yet
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_65e3d7cb392d424790b7f9b335725632.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_65e3d7cb392d424790b7f9b335725632.jpg not downloaded yet
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_5311bbfae1f1bf623c716432de2a1660.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_5311bbfae1f1bf623c716432de2a1660.jpg not downloaded yet
2026-03-28 10:39:09 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-28 10:39:09 [auto1.de] INFO: Scrape type for RG68419: 1
2026-03-28 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR37862/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_f5bab0a413abd29172fd265d29a10608.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_f5bab0a413abd29172fd265d29a10608.jpg not downloaded yet
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_2c03cacdc9107333dd474a477cb6d38f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_2c03cacdc9107333dd474a477cb6d38f.jpg not downloaded yet
2026-03-28 10:39:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_4821baa638c69975eb5a28fad830d428.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:10 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [auto1.de] INFO: Scrape type for NE45887: 1
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_7602d5e31ef6d7d98ace40bde0241abf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_7602d5e31ef6d7d98ace40bde0241abf.jpg not downloaded yet
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_d08cfa735c5fcf842c339bc980c7ef4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_d08cfa735c5fcf842c339bc980c7ef4b.jpg not downloaded yet
2026-03-28 10:39:10 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [auto1.de] INFO: Scrape type for VZ98908: 1
2026-03-28 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf4d690>
2026-03-28 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_63f73e03111ac1771da8fc3a10bb9718.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_63f73e03111ac1771da8fc3a10bb9718.jpg saved to cache
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7fc5a3a0-9801-53af-970f-10ff26ba3835
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_52fb7fab7f14a38d758c3fb8c4c59196.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_52fb7fab7f14a38d758c3fb8c4c59196.jpg not downloaded yet
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_17a6370404d18742d2e67585f2c140f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_17a6370404d18742d2e67585f2c140f6.jpg not downloaded yet
2026-03-28 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_5311bbfae1f1bf623c716432de2a1660.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:10 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-28 10:39:10 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-28 10:39:10 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [auto1.de] INFO: Scrape type for BH58500: 1
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_8148e794d1a0d3043150cf278a49f38c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_8148e794d1a0d3043150cf278a49f38c.jpg not downloaded yet
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_bb92d4bad7e3a65bc3d31743fd7668af.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_bb92d4bad7e3a65bc3d31743fd7668af.jpg not downloaded yet
2026-03-28 10:39:10 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 9638 | hits on page: 40
2026-03-28 10:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe336d0>
2026-03-28 10:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_4821baa638c69975eb5a28fad830d428.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_4821baa638c69975eb5a28fad830d428.jpg saved to cache
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7fc5a3a0-9801-53af-970f-10ff26ba3835
2026-03-28 10:39:10 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [auto1.de] INFO: Scrape type for FN47599: 1
2026-03-28 10:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_eecf49acce334e621fbb919808e42b21.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_4cf6fe82dacd25d3a2c1db8105508714.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_4cf6fe82dacd25d3a2c1db8105508714.jpg not downloaded yet
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_fdc321e43fe841de4463a7004b780806.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_fdc321e43fe841de4463a7004b780806.jpg not downloaded yet
2026-03-28 10:39:10 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP40190%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [auto1.de] INFO: Scrape type for JP40190: 2
2026-03-28 10:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190
2026-03-28 10:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c51401d-33e2-5333-9397-86fdd33486ce with scrape type 2
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c51401d-33e2-5333-9397-86fdd33486ce with scrape type 2
2026-03-28 10:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c51401d-33e2-5333-9397-86fdd33486ce, identifier: JP40190
2026-03-28 10:39:10 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-28 10:39:10 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS16399%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [auto1.de] INFO: Scrape type for JS16399: 2
2026-03-28 10:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399
2026-03-28 10:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with scrape type 2
2026-03-28 10:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with scrape type 2
2026-03-28 10:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 552f88f6-5c52-5f67-92aa-4ea5c77aad73, identifier: JS16399
2026-03-28 10:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190
2026-03-28 10:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190
2026-03-28 10:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c51401d-33e2-5333-9397-86fdd33486ce with identifier: JP40190 to the API
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:14:32Z',
 'fuel_type': 'diesel',
 'id': '8c51401d-33e2-5333-9397-86fdd33486ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP40190',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 75294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Comfortline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline DoubleCab 4Motion',
 'year': 2019}
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP40190%27 HTTP/1.1" 200 None
2026-03-28 10:39:10 [auto1.de] INFO: Saving data for JP40190: {'auction_closing_time': 1774883672.0, 'created_time': 1774002148.536693, 'last_price_update_time': 1774694350.934707}
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP40190') HTTP/1.1" 204 0
2026-03-28 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399
2026-03-28 10:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399
2026-03-28 10:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 552f88f6-5c52-5f67-92aa-4ea5c77aad73 with identifier: JS16399 to the API
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:40:19Z',
 'fuel_type': 'petrol',
 'id': '552f88f6-5c52-5f67-92aa-4ea5c77aad73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS16399',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 175106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-13',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 High up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'High  BlueMotion Tech',
 'year': 2012}
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS16399%27 HTTP/1.1" 200 None
2026-03-28 10:39:11 [auto1.de] INFO: Saving data for JS16399: {'auction_closing_time': 1774885219.0, 'created_time': 1774034365.785527, 'last_price_update_time': 1774694351.438306}
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS16399') HTTP/1.1" 204 0
2026-03-28 10:39:11 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-28 10:39:11 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN77870%27 HTTP/1.1" 200 None
2026-03-28 10:39:11 [auto1.de] INFO: Scrape type for JN77870: 1
2026-03-28 10:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_17a6370404d18742d2e67585f2c140f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:11 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-28 10:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad18d0>
2026-03-28 10:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_5311bbfae1f1bf623c716432de2a1660.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_5311bbfae1f1bf623c716432de2a1660.jpg saved to cache
2026-03-28 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7fc5a3a0-9801-53af-970f-10ff26ba3835
2026-03-28 10:39:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd46a90>
2026-03-28 10:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F8d%252F278dfdb7b7f48b5a9ac5815f0619dfc6%252Fpa%252FPB79978_eecf49acce334e621fbb919808e42b21.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_eecf49acce334e621fbb919808e42b21.jpg saved to cache
2026-03-28 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9
2026-03-28 10:39:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 935cdd8d-12b7-5c60-b749-5efc19aed1d9, skipping ID generation
2026-03-28 10:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with scrape type 1
2026-03-28 10:39:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 935cdd8d-12b7-5c60-b749-5efc19aed1d9 sending to next pipeline
2026-03-28 10:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 935cdd8d-12b7-5c60-b749-5efc19aed1d9, identifier: PB79978
2026-03-28 10:39:11 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-28 10:39:11 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-28 10:39:11 [auto1.de] INFO: Scrape type for LR31578: 1
2026-03-28 10:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978
2026-03-28 10:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978
2026-03-28 10:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 935cdd8d-12b7-5c60-b749-5efc19aed1d9 with identifier: PB79978 to the API
2026-03-28 10:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_eecf49acce334e621fbb919808e42b21.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:39:12Z',
 'fuel_type': 'petrol',
 'id': '935cdd8d-12b7-5c60-b749-5efc19aed1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB79978',
 'listing': 'auction',
 'location': 'DE, Hof',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 88914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_91ca174b12b437547d8f58525026e4a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2304321,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_eecf49acce334e621fbb919808e42b21.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_888fa0506797c4732d3cada64c987f2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2442517,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_d30005b92f363b21f619ae1e6a1e0d10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2374261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_d53f394094d9b743a6e290bfd8d81a49.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_891c74bb7860b02d852792e703b29d3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_fca113d9bee88ea8f3ad3cd6eeca64f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_5e1d923a6de70eda29c1b0a5db5d242d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2492044,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_c4403434538e7c0a37d0370bae4f6bfb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_935cdd8d-12b7-5c60-b749-5efc19aed1d9/935cdd8d-12b7-5c60-b749-5efc19aed1d9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2203832,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/8d/278dfdb7b7f48b5a9ac5815f0619dfc6/pa/PB79978_8f0ec9ac26f7df204000e820174dc0ab.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2017}
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB79978%27 HTTP/1.1" 200 None
2026-03-28 10:39:12 [auto1.de] INFO: Saving data for PB79978: {'created_time': 1774694352.142157, 'last_price_update_time': 1774694352.142168, 'auction_closing_time': 1774885152.0}
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB79978') HTTP/1.1" 204 0
2026-03-28 10:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF41650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33816%27 HTTP/1.1" 200 None
2026-03-28 10:39:12 [auto1.de] INFO: Scrape type for KV33816: 1
2026-03-28 10:39:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a0ec90>
2026-03-28 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_17a6370404d18742d2e67585f2c140f6.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_17a6370404d18742d2e67585f2c140f6.jpg saved to cache
2026-03-28 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_fdc321e43fe841de4463a7004b780806.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV90577%27 HTTP/1.1" 200 None
2026-03-28 10:39:12 [auto1.de] INFO: Scrape type for MV90577: 2
2026-03-28 10:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577
2026-03-28 10:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54332895-5083-5c7a-bd18-7855ded463dc with scrape type 2
2026-03-28 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54332895-5083-5c7a-bd18-7855ded463dc with scrape type 2
2026-03-28 10:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54332895-5083-5c7a-bd18-7855ded463dc, identifier: MV90577
2026-03-28 10:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577
2026-03-28 10:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577
2026-03-28 10:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54332895-5083-5c7a-bd18-7855ded463dc with identifier: MV90577 to the API
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:15:03Z',
 'fuel_type': 'diesel',
 'id': '54332895-5083-5c7a-bd18-7855ded463dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV90577',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 75676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV90577%27 HTTP/1.1" 200 None
2026-03-28 10:39:12 [auto1.de] INFO: Saving data for MV90577: {'auction_closing_time': 1774883703.0, 'created_time': 1774002213.526079, 'last_price_update_time': 1774694352.740395}
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV90577') HTTP/1.1" 204 0
2026-03-28 10:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_94b75fd9cb4068277de5a2e3e544c74e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55649%27 HTTP/1.1" 200 None
2026-03-28 10:39:12 [auto1.de] INFO: Scrape type for DF55649: 1
2026-03-28 10:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe91b90>
2026-03-28 10:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_fdc321e43fe841de4463a7004b780806.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_fdc321e43fe841de4463a7004b780806.jpg saved to cache
2026-03-28 10:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED71538%27 HTTP/1.1" 200 None
2026-03-28 10:39:12 [auto1.de] INFO: Scrape type for ED71538: 1
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ47645%27 HTTP/1.1" 200 None
2026-03-28 10:39:12 [auto1.de] INFO: Scrape type for PJ47645: 1
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT04321%27 HTTP/1.1" 200 None
2026-03-28 10:39:12 [auto1.de] INFO: Scrape type for UT04321: 1
2026-03-28 10:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ08958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF72133%27 HTTP/1.1" 200 None
2026-03-28 10:39:12 [auto1.de] INFO: Scrape type for DF72133: 1
2026-03-28 10:39:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:12 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-28 10:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL77282%27 HTTP/1.1" 200 None
2026-03-28 10:39:13 [auto1.de] INFO: Scrape type for RL77282: 1
2026-03-28 10:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabee0650>
2026-03-28 10:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fd9%252F0ad9f16d1c140b19267aa0f6e9654c10%252Fpa%252FWV82579_94b75fd9cb4068277de5a2e3e544c74e.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_94b75fd9cb4068277de5a2e3e544c74e.jpg saved to cache
2026-03-28 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d
2026-03-28 10:39:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d, skipping ID generation
2026-03-28 10:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with scrape type 1
2026-03-28 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d sending to next pipeline
2026-03-28 10:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d, identifier: WV82579
2026-03-28 10:39:13 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC99241%27 HTTP/1.1" 200 None
2026-03-28 10:39:13 [auto1.de] INFO: Scrape type for NC99241: 1
2026-03-28 10:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579
2026-03-28 10:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579
2026-03-28 10:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32fd4dcc-6f40-5219-9e5a-a86bc1acd48d with identifier: WV82579 to the API
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_94b75fd9cb4068277de5a2e3e544c74e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:39:10Z',
 'fuel_type': 'petrol',
 'id': '32fd4dcc-6f40-5219-9e5a-a86bc1acd48d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV82579',
 'listing': 'auction',
 'location': 'DE, Krefeld',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 198919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_0d56bf5893538982162c22dceb98c02a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2956440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_94b75fd9cb4068277de5a2e3e544c74e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_dbf477035d70cee5e1b2c0d3b0288497.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3196608,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_00602018f9ad6efadcf0ee2e94332ff5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_ee39957ceb3f7a24868553a35946736c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745878,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_f7dc0405008c846ec41c6119d089d643.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3088371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_9f826a3b61c856f0dce20174f84480f8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61597,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_37e4b8352722cc6fea4af53452e3a9fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_8b502cf21e229f570a8bf9fe2f8c13c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_32fd4dcc-6f40-5219-9e5a-a86bc1acd48d/32fd4dcc-6f40-5219-9e5a-a86bc1acd48d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/d9/0ad9f16d1c140b19267aa0f6e9654c10/pa/WV82579_8ffff17eb7ace9d701f7dd904845da8c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV82579%27 HTTP/1.1" 200 None
2026-03-28 10:39:13 [auto1.de] INFO: Saving data for WV82579: {'created_time': 1774694353.584955, 'last_price_update_time': 1774694353.584966, 'auction_closing_time': 1774885150.0}
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV82579') HTTP/1.1" 204 0
2026-03-28 10:39:13 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW14341%27 HTTP/1.1" 200 None
2026-03-28 10:39:13 [auto1.de] INFO: Scrape type for YW14341: 2
2026-03-28 10:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341
2026-03-28 10:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e05177-bcae-5a46-a30e-320e1cef2df7 with scrape type 2
2026-03-28 10:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e05177-bcae-5a46-a30e-320e1cef2df7 with scrape type 2
2026-03-28 10:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61e05177-bcae-5a46-a30e-320e1cef2df7, identifier: YW14341
2026-03-28 10:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_a9c99f62c5f82357b4145430ba55da75.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341
2026-03-28 10:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341
2026-03-28 10:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61e05177-bcae-5a46-a30e-320e1cef2df7 with identifier: YW14341 to the API
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:30Z',
 'fuel_type': 'diesel',
 'id': '61e05177-bcae-5a46-a30e-320e1cef2df7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW14341',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 153938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW14341%27 HTTP/1.1" 200 None
2026-03-28 10:39:14 [auto1.de] INFO: Saving data for YW14341: {'auction_closing_time': 1774884210.0, 'created_time': 1774089512.377336, 'last_price_update_time': 1774694354.076735}
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW14341') HTTP/1.1" 204 0
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94546%27 HTTP/1.1" 200 None
2026-03-28 10:39:14 [auto1.de] INFO: Scrape type for WB94546: 1
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV05660%27 HTTP/1.1" 200 None
2026-03-28 10:39:14 [auto1.de] INFO: Scrape type for LV05660: 1
2026-03-28 10:39:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe90c10>
2026-03-28 10:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_a9c99f62c5f82357b4145430ba55da75.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_a9c99f62c5f82357b4145430ba55da75.jpg saved to cache
2026-03-28 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ37250%27 HTTP/1.1" 200 None
2026-03-28 10:39:14 [auto1.de] INFO: Scrape type for UJ37250: 1
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF02767%27 HTTP/1.1" 200 None
2026-03-28 10:39:14 [auto1.de] INFO: Scrape type for BF02767: 1
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: GB42768
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB42768%27 HTTP/1.1" 200 None
2026-03-28 10:39:14 [auto1.de] INFO: Scrape type for GB42768: 1
2026-03-28 10:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_42d30f7b9aa95a93c6c6d4237dbb521b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00661%27 HTTP/1.1" 200 None
2026-03-28 10:39:14 [auto1.de] INFO: Scrape type for HX00661: 1
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-28 10:39:14 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-28 10:39:14 [auto1.de] INFO: Scrape type for RC95289: 2
2026-03-28 10:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289
2026-03-28 10:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23321a31-5475-5504-9de8-4b2a22945016 with scrape type 2
2026-03-28 10:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23321a31-5475-5504-9de8-4b2a22945016 with scrape type 2
2026-03-28 10:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23321a31-5475-5504-9de8-4b2a22945016, identifier: RC95289
2026-03-28 10:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289
2026-03-28 10:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289
2026-03-28 10:39:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23321a31-5475-5504-9de8-4b2a22945016 with identifier: RC95289 to the API
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:07Z',
 'fuel_type': 'diesel',
 'id': '23321a31-5475-5504-9de8-4b2a22945016',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC95289',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 217198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-28 10:39:14 [auto1.de] INFO: Saving data for RC95289: {'auction_closing_time': 1774884067.0, 'created_time': 1773382855.197107, 'last_price_update_time': 1774694354.981745}
2026-03-28 10:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC95289') HTTP/1.1" 204 0
2026-03-28 10:39:15 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-28 10:39:15 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [auto1.de] INFO: Scrape type for GE96927: 1
2026-03-28 10:39:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd39850>
2026-03-28 10:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_42d30f7b9aa95a93c6c6d4237dbb521b.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_42d30f7b9aa95a93c6c6d4237dbb521b.jpg saved to cache
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XN06908> (referer: https://www.auto1.com/v1/car-details-view/XN06908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908
2026-03-28 10:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with scrape type 1
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_1b868ffc2812d9a57de05525e84c4ea0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_1b868ffc2812d9a57de05525e84c4ea0.jpg not downloaded yet
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_9a8fd621bd06543758a64b97d3d5ec3a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_9a8fd621bd06543758a64b97d3d5ec3a.jpg not downloaded yet
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_30c2dd96539b2ce685ae8e02080aa1d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_30c2dd96539b2ce685ae8e02080aa1d9.jpg not downloaded yet
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_07ae2f45f7e4c9d207defbfc6be4ae2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_07ae2f45f7e4c9d207defbfc6be4ae2f.jpg not downloaded yet
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_6b557b4cfd7093a974ed355454bcbe45.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_6b557b4cfd7093a974ed355454bcbe45.jpg not downloaded yet
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_a5532e39ccaf848abc8de8d6f5fccbd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_a5532e39ccaf848abc8de8d6f5fccbd7.jpg not downloaded yet
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_12969f50e086f077ba5925adb0e65ed3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_12969f50e086f077ba5925adb0e65ed3.jpg not downloaded yet
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_ac0cbe3aa90f8620cdbd757e45336636.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_ac0cbe3aa90f8620cdbd757e45336636.jpg not downloaded yet
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_cd51ef9b6541566c5f68ef841e524077.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_cd51ef9b6541566c5f68ef841e524077.jpg not downloaded yet
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_98bf8ca69ba437e68beabe5df05d062d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_98bf8ca69ba437e68beabe5df05d062d.jpg not downloaded yet
2026-03-28 10:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV72554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE70575/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_98bf8ca69ba437e68beabe5df05d062d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf71a90>
2026-03-28 10:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_98bf8ca69ba437e68beabe5df05d062d.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_98bf8ca69ba437e68beabe5df05d062d.jpg saved to cache
2026-03-28 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU85035> (referer: https://www.auto1.com/v1/car-details-view/RU85035/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035
2026-03-28 10:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b5d4e7-2221-54c7-b92b-845280338fb5 with scrape type 1
2026-03-28 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d4b5d4e7-2221-54c7-b92b-845280338fb5
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fba%252Fc1ba030367dd8c03071bd3ae22adba3d%252Fpa%252FRU85035_83c6897ff7aa9741447dd77d477e8cf9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_83c6897ff7aa9741447dd77d477e8cf9.jpg already downloaded
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fba%252Fc1ba030367dd8c03071bd3ae22adba3d%252Fpa%252FRU85035_753fec5bee74962e930aabc67cc8cf4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_753fec5bee74962e930aabc67cc8cf4c.jpg already downloaded
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fba%252Fc1ba030367dd8c03071bd3ae22adba3d%252Fpa%252FRU85035_a1f2f8a87e0a3cd39e9bad96ec98939c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_a1f2f8a87e0a3cd39e9bad96ec98939c.jpg already downloaded
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fba%252Fc1ba030367dd8c03071bd3ae22adba3d%252Fpa%252FRU85035_f68292286224b6c473b32ebd7c5176f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_f68292286224b6c473b32ebd7c5176f0.jpg already downloaded
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252Fba%252Fc1ba030367dd8c03071bd3ae22adba3d%252Fpa%252FRU85035_19290e8ef30752d3954b27dab34d1dbe.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_19290e8ef30752d3954b27dab34d1dbe.jpg already downloaded
2026-03-28 10:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4b5d4e7-2221-54c7-b92b-845280338fb5, identifier: RU85035
2026-03-28 10:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035
2026-03-28 10:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035
2026-03-28 10:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4b5d4e7-2221-54c7-b92b-845280338fb5 with identifier: RU85035 to the API
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RU85035>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:56:28Z',
 'fuel_type': 'petrol',
 'id': 'd4b5d4e7-2221-54c7-b92b-845280338fb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU85035',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 146737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_83c6897ff7aa9741447dd77d477e8cf9.jpg',
                'https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_753fec5bee74962e930aabc67cc8cf4c.jpg',
                'https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_a1f2f8a87e0a3cd39e9bad96ec98939c.jpg',
                'https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_f68292286224b6c473b32ebd7c5176f0.jpg',
                'https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_19290e8ef30752d3954b27dab34d1dbe.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b5d4e7-2221-54c7-b92b-845280338fb5/d4b5d4e7-2221-54c7-b92b-845280338fb5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_83c6897ff7aa9741447dd77d477e8cf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b5d4e7-2221-54c7-b92b-845280338fb5/d4b5d4e7-2221-54c7-b92b-845280338fb5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_753fec5bee74962e930aabc67cc8cf4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b5d4e7-2221-54c7-b92b-845280338fb5/d4b5d4e7-2221-54c7-b92b-845280338fb5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_a1f2f8a87e0a3cd39e9bad96ec98939c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b5d4e7-2221-54c7-b92b-845280338fb5/d4b5d4e7-2221-54c7-b92b-845280338fb5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_f68292286224b6c473b32ebd7c5176f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4b5d4e7-2221-54c7-b92b-845280338fb5/d4b5d4e7-2221-54c7-b92b-845280338fb5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 128622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/ba/c1ba030367dd8c03071bd3ae22adba3d/pa/RU85035_19290e8ef30752d3954b27dab34d1dbe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2012}
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU85035%27 HTTP/1.1" 200 None
2026-03-28 10:39:17 [auto1.de] INFO: Saving data for RU85035: {'created_time': 1774694357.354765, 'last_price_update_time': 1774694357.354775, 'auction_closing_time': 1774886188.0}
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU85035') HTTP/1.1" 204 0
2026-03-28 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_cd51ef9b6541566c5f68ef841e524077.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DM55805> (referer: https://www.auto1.com/v1/car-details-view/DM55805/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb3d10>
2026-03-28 10:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_cd51ef9b6541566c5f68ef841e524077.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_cd51ef9b6541566c5f68ef841e524077.jpg saved to cache
2026-03-28 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV71817/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805
2026-03-28 10:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a3f917b-5f2b-5942-8e54-3d38f01058ca with scrape type 1
2026-03-28 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5a3f917b-5f2b-5942-8e54-3d38f01058ca
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F2921d53ce37fb6d12867b0d85547340a%252Fpa%252FDM55805_6baf19bcc692c88829ed418c4d2a65bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_6baf19bcc692c88829ed418c4d2a65bd.jpg already downloaded
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F2921d53ce37fb6d12867b0d85547340a%252Fpa%252FDM55805_fa98f745db1fb288cd6ec0a06395ccb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_fa98f745db1fb288cd6ec0a06395ccb1.jpg already downloaded
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F2921d53ce37fb6d12867b0d85547340a%252Fpa%252FDM55805_92e5c0fd55ddb2d96bab2b98488e9167.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_92e5c0fd55ddb2d96bab2b98488e9167.jpg already downloaded
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F2921d53ce37fb6d12867b0d85547340a%252Fpa%252FDM55805_68aaa3b7466d15a2de12b47c5dc328a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_68aaa3b7466d15a2de12b47c5dc328a6.jpg already downloaded
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F21%252F2921d53ce37fb6d12867b0d85547340a%252Fpa%252FDM55805_d8344e92d1f225e43b6812dcb5f257b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_d8344e92d1f225e43b6812dcb5f257b1.jpg already downloaded
2026-03-28 10:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a3f917b-5f2b-5942-8e54-3d38f01058ca, identifier: DM55805
2026-03-28 10:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805
2026-03-28 10:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805
2026-03-28 10:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a3f917b-5f2b-5942-8e54-3d38f01058ca with identifier: DM55805 to the API
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DM55805>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:20:15Z',
 'fuel_type': 'petrol',
 'id': '5a3f917b-5f2b-5942-8e54-3d38f01058ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM55805',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 136090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_6baf19bcc692c88829ed418c4d2a65bd.jpg',
                'https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_fa98f745db1fb288cd6ec0a06395ccb1.jpg',
                'https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_92e5c0fd55ddb2d96bab2b98488e9167.jpg',
                'https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_68aaa3b7466d15a2de12b47c5dc328a6.jpg',
                'https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_d8344e92d1f225e43b6812dcb5f257b1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a3f917b-5f2b-5942-8e54-3d38f01058ca/5a3f917b-5f2b-5942-8e54-3d38f01058ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_6baf19bcc692c88829ed418c4d2a65bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a3f917b-5f2b-5942-8e54-3d38f01058ca/5a3f917b-5f2b-5942-8e54-3d38f01058ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109716,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_fa98f745db1fb288cd6ec0a06395ccb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a3f917b-5f2b-5942-8e54-3d38f01058ca/5a3f917b-5f2b-5942-8e54-3d38f01058ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_92e5c0fd55ddb2d96bab2b98488e9167.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a3f917b-5f2b-5942-8e54-3d38f01058ca/5a3f917b-5f2b-5942-8e54-3d38f01058ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_68aaa3b7466d15a2de12b47c5dc328a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a3f917b-5f2b-5942-8e54-3d38f01058ca/5a3f917b-5f2b-5942-8e54-3d38f01058ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/21/2921d53ce37fb6d12867b0d85547340a/pa/DM55805_d8344e92d1f225e43b6812dcb5f257b1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM55805%27 HTTP/1.1" 200 None
2026-03-28 10:39:18 [auto1.de] INFO: Saving data for DM55805: {'created_time': 1774694358.070033, 'last_price_update_time': 1774694358.070043, 'auction_closing_time': 1774884015.0}
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM55805') HTTP/1.1" 204 0
2026-03-28 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_12969f50e086f077ba5925adb0e65ed3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_ac0cbe3aa90f8620cdbd757e45336636.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf70410>
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_12969f50e086f077ba5925adb0e65ed3.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_12969f50e086f077ba5925adb0e65ed3.jpg saved to cache
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd39ed0>
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_ac0cbe3aa90f8620cdbd757e45336636.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_ac0cbe3aa90f8620cdbd757e45336636.jpg saved to cache
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_6b557b4cfd7093a974ed355454bcbe45.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_a5532e39ccaf848abc8de8d6f5fccbd7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_30c2dd96539b2ce685ae8e02080aa1d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf698d0>
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_6b557b4cfd7093a974ed355454bcbe45.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_6b557b4cfd7093a974ed355454bcbe45.jpg saved to cache
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd43910>
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_a5532e39ccaf848abc8de8d6f5fccbd7.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_a5532e39ccaf848abc8de8d6f5fccbd7.jpg saved to cache
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabee26d0>
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_30c2dd96539b2ce685ae8e02080aa1d9.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_30c2dd96539b2ce685ae8e02080aa1d9.jpg saved to cache
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_07ae2f45f7e4c9d207defbfc6be4ae2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV33816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_9a8fd621bd06543758a64b97d3d5ec3a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd410d0>
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_07ae2f45f7e4c9d207defbfc6be4ae2f.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_07ae2f45f7e4c9d207defbfc6be4ae2f.jpg saved to cache
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88dce10>
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_9a8fd621bd06543758a64b97d3d5ec3a.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_9a8fd621bd06543758a64b97d3d5ec3a.jpg saved to cache
2026-03-28 10:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_1b868ffc2812d9a57de05525e84c4ea0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88f8550>
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252Fad%252F35add05a3f33f4538a78575168bd107d%252Fpa%252FXN06908_1b868ffc2812d9a57de05525e84c4ea0.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_1b868ffc2812d9a57de05525e84c4ea0.jpg saved to cache
2026-03-28 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8
2026-03-28 10:39:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8, skipping ID generation
2026-03-28 10:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with scrape type 1
2026-03-28 10:39:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 sending to next pipeline
2026-03-28 10:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8, identifier: XN06908
2026-03-28 10:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908
2026-03-28 10:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908
2026-03-28 10:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d01d59a-ee3b-566a-8040-a9a8ecc225e8 with identifier: XN06908 to the API
2026-03-28 10:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_1b868ffc2812d9a57de05525e84c4ea0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:52:23Z',
 'fuel_type': 'petrol',
 'id': '6d01d59a-ee3b-566a-8040-a9a8ecc225e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN06908',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 127929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3203383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_1b868ffc2812d9a57de05525e84c4ea0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_9a8fd621bd06543758a64b97d3d5ec3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_30c2dd96539b2ce685ae8e02080aa1d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_07ae2f45f7e4c9d207defbfc6be4ae2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_6b557b4cfd7093a974ed355454bcbe45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_a5532e39ccaf848abc8de8d6f5fccbd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_12969f50e086f077ba5925adb0e65ed3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2893247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_ac0cbe3aa90f8620cdbd757e45336636.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_cd51ef9b6541566c5f68ef841e524077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d01d59a-ee3b-566a-8040-a9a8ecc225e8/6d01d59a-ee3b-566a-8040-a9a8ecc225e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/ad/35add05a3f33f4538a78575168bd107d/pa/XN06908_98bf8ca69ba437e68beabe5df05d062d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2019}
2026-03-28 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06908%27 HTTP/1.1" 200 None
2026-03-28 10:39:19 [auto1.de] INFO: Saving data for XN06908: {'created_time': 1774694359.75549, 'last_price_update_time': 1774694359.755501, 'auction_closing_time': 1774885943.0}
2026-03-28 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN06908') HTTP/1.1" 204 0
2026-03-28 10:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC99241/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:22 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.513(s), this was the 1st time calling it.
2026-03-28 10:39:22 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.695797606910153 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:39:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF02767/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GA70819/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FN47599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 10:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE70575> (referer: https://www.auto1.com/v1/car-details-view/FE70575/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575
2026-03-28 10:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with scrape type 1
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_5b5664be1e66bac8e7a6f61d36f53605.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_5b5664be1e66bac8e7a6f61d36f53605.jpg not downloaded yet
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_816d94c2538ff5978405bb5045d63f70.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_816d94c2538ff5978405bb5045d63f70.jpg not downloaded yet
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_25fcfa0536a844ac7ecdc10abe90cc57.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_25fcfa0536a844ac7ecdc10abe90cc57.jpg not downloaded yet
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_8825c1e5bc4482e50c51c7348b0f0c76.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_8825c1e5bc4482e50c51c7348b0f0c76.jpg not downloaded yet
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_910cc1972475d378491a6f601737d33e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_910cc1972475d378491a6f601737d33e.jpg not downloaded yet
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_926b4f3cde342876937fbb958550fbf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_926b4f3cde342876937fbb958550fbf0.jpg not downloaded yet
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_803fe2368b8cbf43336f54ec182954d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_803fe2368b8cbf43336f54ec182954d7.jpg not downloaded yet
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_34b05b00af8b821eaa01908d4102d91b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_34b05b00af8b821eaa01908d4102d91b.jpg not downloaded yet
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_6c2b96a886f296c5aa9e5ef74e2e02c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_6c2b96a886f296c5aa9e5ef74e2e02c9.jpg not downloaded yet
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_8da494be55a51425350161bc56e32dbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_8da494be55a51425350161bc56e32dbd.jpg not downloaded yet
2026-03-28 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV71817> (referer: https://www.auto1.com/v1/car-details-view/NV71817/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817
2026-03-28 10:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8e8c73-2548-5053-a372-7709a20b14be with scrape type 1
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_c9c29bacdd440e0fe83aca8a29b1b861.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_c9c29bacdd440e0fe83aca8a29b1b861.jpg not downloaded yet
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_fe61af0402af07e0e13f7ff2ca025d3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_fe61af0402af07e0e13f7ff2ca025d3d.jpg not downloaded yet
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_0f842ac71626aff9dd6a287734d72da0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_0f842ac71626aff9dd6a287734d72da0.jpg not downloaded yet
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_3694e6692efd97ed0fef3b2b18de868f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_3694e6692efd97ed0fef3b2b18de868f.jpg not downloaded yet
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_8bbb9a366cce6042ceac50096b9df1cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_8bbb9a366cce6042ceac50096b9df1cc.jpg not downloaded yet
2026-03-28 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_8da494be55a51425350161bc56e32dbd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_1778ff67348a774b3b0ef1548b08adec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_1778ff67348a774b3b0ef1548b08adec.jpg not downloaded yet
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_f35e9fee3403aa8b0c815c8a46ea9fb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_f35e9fee3403aa8b0c815c8a46ea9fb7.jpg not downloaded yet
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_62146a1f667231dc9a1a265a53aebddf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_62146a1f667231dc9a1a265a53aebddf.jpg not downloaded yet
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_870b88d5ee24ca88f3153ded761ac043.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_870b88d5ee24ca88f3153ded761ac043.jpg not downloaded yet
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_461869969a212dd9a371c65912f78eeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_461869969a212dd9a371c65912f78eeb.jpg not downloaded yet
2026-03-28 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf97e50>
2026-03-28 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_8da494be55a51425350161bc56e32dbd.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_8da494be55a51425350161bc56e32dbd.jpg saved to cache
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_8bbb9a366cce6042ceac50096b9df1cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe827d0>
2026-03-28 10:39:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_8bbb9a366cce6042ceac50096b9df1cc.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_8bbb9a366cce6042ceac50096b9df1cc.jpg saved to cache
2026-03-28 10:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_461869969a212dd9a371c65912f78eeb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX00661/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_870b88d5ee24ca88f3153ded761ac043.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf74cd0>
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_461869969a212dd9a371c65912f78eeb.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_461869969a212dd9a371c65912f78eeb.jpg saved to cache
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW14038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba8034d0>
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_870b88d5ee24ca88f3153ded761ac043.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_870b88d5ee24ca88f3153ded761ac043.jpg saved to cache
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_62146a1f667231dc9a1a265a53aebddf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_1778ff67348a774b3b0ef1548b08adec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_f35e9fee3403aa8b0c815c8a46ea9fb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_3694e6692efd97ed0fef3b2b18de868f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd756d0>
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_62146a1f667231dc9a1a265a53aebddf.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_62146a1f667231dc9a1a265a53aebddf.jpg saved to cache
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8929850>
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_1778ff67348a774b3b0ef1548b08adec.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_1778ff67348a774b3b0ef1548b08adec.jpg saved to cache
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88afdd0>
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_f35e9fee3403aa8b0c815c8a46ea9fb7.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_f35e9fee3403aa8b0c815c8a46ea9fb7.jpg saved to cache
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8935190>
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_3694e6692efd97ed0fef3b2b18de868f.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_3694e6692efd97ed0fef3b2b18de868f.jpg saved to cache
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_0f842ac71626aff9dd6a287734d72da0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd46910>
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_0f842ac71626aff9dd6a287734d72da0.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_0f842ac71626aff9dd6a287734d72da0.jpg saved to cache
2026-03-28 10:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_fe61af0402af07e0e13f7ff2ca025d3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_c9c29bacdd440e0fe83aca8a29b1b861.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd90c90>
2026-03-28 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_fe61af0402af07e0e13f7ff2ca025d3d.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_fe61af0402af07e0e13f7ff2ca025d3d.jpg saved to cache
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe83d10>
2026-03-28 10:39:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgac%252Fdd%252Facdd81da4020c9db6d1795600ccab8e8%252Fpa%252FNV71817_c9c29bacdd440e0fe83aca8a29b1b861.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_c9c29bacdd440e0fe83aca8a29b1b861.jpg saved to cache
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf8e8c73-2548-5053-a372-7709a20b14be
2026-03-28 10:39:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf8e8c73-2548-5053-a372-7709a20b14be, skipping ID generation
2026-03-28 10:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf8e8c73-2548-5053-a372-7709a20b14be with scrape type 1
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf8e8c73-2548-5053-a372-7709a20b14be sending to next pipeline
2026-03-28 10:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf8e8c73-2548-5053-a372-7709a20b14be, identifier: NV71817
2026-03-28 10:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817
2026-03-28 10:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817
2026-03-28 10:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf8e8c73-2548-5053-a372-7709a20b14be with identifier: NV71817 to the API
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_c9c29bacdd440e0fe83aca8a29b1b861.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 207,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:36:37Z',
 'fuel_type': 'diesel',
 'id': 'bf8e8c73-2548-5053-a372-7709a20b14be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV71817',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 90699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2574560,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_c9c29bacdd440e0fe83aca8a29b1b861.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622921,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_fe61af0402af07e0e13f7ff2ca025d3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_0f842ac71626aff9dd6a287734d72da0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_3694e6692efd97ed0fef3b2b18de868f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556700,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_8bbb9a366cce6042ceac50096b9df1cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_1778ff67348a774b3b0ef1548b08adec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627336,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_f35e9fee3403aa8b0c815c8a46ea9fb7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2520234,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_62146a1f667231dc9a1a265a53aebddf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_870b88d5ee24ca88f3153ded761ac043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8e8c73-2548-5053-a372-7709a20b14be/bf8e8c73-2548-5053-a372-7709a20b14be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgac/dd/acdd81da4020c9db6d1795600ccab8e8/pa/NV71817_461869969a212dd9a371c65912f78eeb.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-28 10:39:32 [auto1.de] INFO: Saving data for NV71817: {'created_time': 1774694372.771765, 'last_price_update_time': 1774694372.771779, 'auction_closing_time': 1774884997.0}
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV71817') HTTP/1.1" 204 0
2026-03-28 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV33816> (referer: https://www.auto1.com/v1/car-details-view/KV33816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_6c2b96a886f296c5aa9e5ef74e2e02c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816
2026-03-28 10:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with scrape type 1
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8dcc66d6-54f0-5149-a0d0-b9e82766ae85
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_7a874e1be7d418664bf809c6cf1eebdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_7a874e1be7d418664bf809c6cf1eebdc.jpg already downloaded
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_f974e6029b19a786d0a2691c9bcf23ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_f974e6029b19a786d0a2691c9bcf23ab.jpg already downloaded
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_891f3bedb21f0e74e05d74337913db28.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_891f3bedb21f0e74e05d74337913db28.jpg already downloaded
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_844bae3fc5c4a5ce15f958b87b75bc3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_844bae3fc5c4a5ce15f958b87b75bc3d.jpg already downloaded
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_7a412a12e063b314a13859c712c1af4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_7a412a12e063b314a13859c712c1af4e.jpg already downloaded
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_efa60733d2b6bc7d86fbb0b467095f60.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_efa60733d2b6bc7d86fbb0b467095f60.jpg already downloaded
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_1384b048579c3a91d5a220c9ec658e0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_1384b048579c3a91d5a220c9ec658e0c.jpg already downloaded
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_06e4f2000391566965d5448547aa15f3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_06e4f2000391566965d5448547aa15f3.jpg already downloaded
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_972ae4c4f310526f66b5684b2a72e216.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_972ae4c4f310526f66b5684b2a72e216.jpg already downloaded
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F50%252F8f50f5fe91315daeb4658a7aec25bea9%252Fpa%252FKV33816_123070cbbec1e273925eb6c2964f626f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_123070cbbec1e273925eb6c2964f626f.jpg already downloaded
2026-03-28 10:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85, identifier: KV33816
2026-03-28 10:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816
2026-03-28 10:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816
2026-03-28 10:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8dcc66d6-54f0-5149-a0d0-b9e82766ae85 with identifier: KV33816 to the API
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV33816>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:59:57Z',
 'fuel_type': 'diesel',
 'id': '8dcc66d6-54f0-5149-a0d0-b9e82766ae85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV33816',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 184044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_7a874e1be7d418664bf809c6cf1eebdc.jpg',
                'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_f974e6029b19a786d0a2691c9bcf23ab.jpg',
                'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_891f3bedb21f0e74e05d74337913db28.jpg',
                'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_844bae3fc5c4a5ce15f958b87b75bc3d.jpg',
                'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_7a412a12e063b314a13859c712c1af4e.jpg',
                'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_efa60733d2b6bc7d86fbb0b467095f60.jpg',
                'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_1384b048579c3a91d5a220c9ec658e0c.jpg',
                'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_06e4f2000391566965d5448547aa15f3.jpg',
                'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_972ae4c4f310526f66b5684b2a72e216.jpg',
                'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_123070cbbec1e273925eb6c2964f626f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_7a874e1be7d418664bf809c6cf1eebdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2451855,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_f974e6029b19a786d0a2691c9bcf23ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2144920,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_891f3bedb21f0e74e05d74337913db28.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2009198,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_844bae3fc5c4a5ce15f958b87b75bc3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_7a412a12e063b314a13859c712c1af4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2337990,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_efa60733d2b6bc7d86fbb0b467095f60.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_1384b048579c3a91d5a220c9ec658e0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2414822,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_06e4f2000391566965d5448547aa15f3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_972ae4c4f310526f66b5684b2a72e216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8dcc66d6-54f0-5149-a0d0-b9e82766ae85/8dcc66d6-54f0-5149-a0d0-b9e82766ae85_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2755210,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/50/8f50f5fe91315daeb4658a7aec25bea9/pa/KV33816_123070cbbec1e273925eb6c2964f626f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2016}
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33816%27 HTTP/1.1" 200 None
2026-03-28 10:39:33 [auto1.de] INFO: Saving data for KV33816: {'created_time': 1774694373.512448, 'last_price_update_time': 1774694373.51246, 'auction_closing_time': 1774886397.0}
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV33816') HTTP/1.1" 204 0
2026-03-28 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_803fe2368b8cbf43336f54ec182954d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB42768/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba802850>
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_6c2b96a886f296c5aa9e5ef74e2e02c9.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_6c2b96a886f296c5aa9e5ef74e2e02c9.jpg saved to cache
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_34b05b00af8b821eaa01908d4102d91b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd2e290>
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_803fe2368b8cbf43336f54ec182954d7.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_803fe2368b8cbf43336f54ec182954d7.jpg saved to cache
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd9c6d0>
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_34b05b00af8b821eaa01908d4102d91b.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_34b05b00af8b821eaa01908d4102d91b.jpg saved to cache
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_8825c1e5bc4482e50c51c7348b0f0c76.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_910cc1972475d378491a6f601737d33e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_926b4f3cde342876937fbb958550fbf0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd38090>
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_8825c1e5bc4482e50c51c7348b0f0c76.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_8825c1e5bc4482e50c51c7348b0f0c76.jpg saved to cache
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd4e190>
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_910cc1972475d378491a6f601737d33e.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_910cc1972475d378491a6f601737d33e.jpg saved to cache
2026-03-28 10:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_816d94c2538ff5978405bb5045d63f70.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe29250>
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_926b4f3cde342876937fbb958550fbf0.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_926b4f3cde342876937fbb958550fbf0.jpg saved to cache
2026-03-28 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a61750>
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_816d94c2538ff5978405bb5045d63f70.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_816d94c2538ff5978405bb5045d63f70.jpg saved to cache
2026-03-28 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_25fcfa0536a844ac7ecdc10abe90cc57.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_5b5664be1e66bac8e7a6f61d36f53605.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe644d0>
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_25fcfa0536a844ac7ecdc10abe90cc57.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_25fcfa0536a844ac7ecdc10abe90cc57.jpg saved to cache
2026-03-28 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ37250/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN77870/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RG68419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV72554> (referer: https://www.auto1.com/v1/car-details-view/XV72554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe142d0>
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252Fcd%252F8fcd56ac755b3aa386ceaf8471fec02a%252Fpa%252FFE70575_5b5664be1e66bac8e7a6f61d36f53605.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_5b5664be1e66bac8e7a6f61d36f53605.jpg saved to cache
2026-03-28 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab
2026-03-28 10:39:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab, skipping ID generation
2026-03-28 10:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with scrape type 1
2026-03-28 10:39:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 45c0f44c-60b5-54b0-8222-5d08a2fb38ab sending to next pipeline
2026-03-28 10:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab, identifier: FE70575
2026-03-28 10:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575
2026-03-28 10:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575
2026-03-28 10:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45c0f44c-60b5-54b0-8222-5d08a2fb38ab with identifier: FE70575 to the API
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_5b5664be1e66bac8e7a6f61d36f53605.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 32,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:06:57Z',
 'fuel_type': 'hybrid',
 'id': '45c0f44c-60b5-54b0-8222-5d08a2fb38ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE70575',
 'listing': 'auction',
 'location': 'DE, Siegen',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 48393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_5b5664be1e66bac8e7a6f61d36f53605.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_816d94c2538ff5978405bb5045d63f70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_25fcfa0536a844ac7ecdc10abe90cc57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_8825c1e5bc4482e50c51c7348b0f0c76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_910cc1972475d378491a6f601737d33e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900359,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_926b4f3cde342876937fbb958550fbf0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_803fe2368b8cbf43336f54ec182954d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3005338,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_34b05b00af8b821eaa01908d4102d91b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_6c2b96a886f296c5aa9e5ef74e2e02c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45c0f44c-60b5-54b0-8222-5d08a2fb38ab/45c0f44c-60b5-54b0-8222-5d08a2fb38ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/cd/8fcd56ac755b3aa386ceaf8471fec02a/pa/FE70575_8da494be55a51425350161bc56e32dbd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-03-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE70575%27 HTTP/1.1" 200 None
2026-03-28 10:39:35 [auto1.de] INFO: Saving data for FE70575: {'created_time': 1774694375.387094, 'last_price_update_time': 1774694375.387105, 'auction_closing_time': 1774883217.0}
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE70575') HTTP/1.1" 204 0
2026-03-28 10:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-03-28 10:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7fa4612-196d-5fd0-8279-b54a17631155 with scrape type 1
2026-03-28 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a7fa4612-196d-5fd0-8279-b54a17631155
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fca%252Fccca0d704d94394c639071077cf2ba27%252Fpa%252FXV72554_2ae62951222ed4718c3979981c5387b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_2ae62951222ed4718c3979981c5387b5.jpg already downloaded
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fca%252Fccca0d704d94394c639071077cf2ba27%252Fpa%252FXV72554_76e1c37d9c4e2a7b222e7618d2275421.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_76e1c37d9c4e2a7b222e7618d2275421.jpg already downloaded
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fca%252Fccca0d704d94394c639071077cf2ba27%252Fpa%252FXV72554_9b10511411717b429c802fba3d9f51d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_9b10511411717b429c802fba3d9f51d9.jpg already downloaded
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fca%252Fccca0d704d94394c639071077cf2ba27%252Fpa%252FXV72554_241b93956b5839559730af6b644c508b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_241b93956b5839559730af6b644c508b.jpg already downloaded
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fca%252Fccca0d704d94394c639071077cf2ba27%252Fpa%252FXV72554_38364fd24d97f7ebea40ce330a0d98fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_38364fd24d97f7ebea40ce330a0d98fd.jpg already downloaded
2026-03-28 10:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7fa4612-196d-5fd0-8279-b54a17631155, identifier: XV72554
2026-03-28 10:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-03-28 10:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554
2026-03-28 10:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7fa4612-196d-5fd0-8279-b54a17631155 with identifier: XV72554 to the API
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XV72554>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:56:15Z',
 'fuel_type': 'petrol',
 'id': 'a7fa4612-196d-5fd0-8279-b54a17631155',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV72554',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Skoda',
 'model': 'Rapid',
 'odometer': 206641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_2ae62951222ed4718c3979981c5387b5.jpg',
                'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_76e1c37d9c4e2a7b222e7618d2275421.jpg',
                'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_9b10511411717b429c802fba3d9f51d9.jpg',
                'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_241b93956b5839559730af6b644c508b.jpg',
                'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_38364fd24d97f7ebea40ce330a0d98fd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_2ae62951222ed4718c3979981c5387b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_76e1c37d9c4e2a7b222e7618d2275421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_9b10511411717b429c802fba3d9f51d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_241b93956b5839559730af6b644c508b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7fa4612-196d-5fd0-8279-b54a17631155/a7fa4612-196d-5fd0-8279-b54a17631155_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/ca/ccca0d704d94394c639071077cf2ba27/pa/XV72554_38364fd24d97f7ebea40ce330a0d98fd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Rapid 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-28 10:39:35 [auto1.de] INFO: Saving data for XV72554: {'created_time': 1774694375.905778, 'last_price_update_time': 1774694375.905789, 'auction_closing_time': 1774886175.0}
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV72554') HTTP/1.1" 204 0
2026-03-28 10:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF02767> (referer: https://www.auto1.com/v1/car-details-view/BF02767/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767
2026-03-28 10:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with scrape type 1
2026-03-28 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_10b2b44060288b99dfcb513818506583.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_10b2b44060288b99dfcb513818506583.jpg not downloaded yet
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_5092ec2f347b0b31b8776af38d58ccef.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_5092ec2f347b0b31b8776af38d58ccef.jpg not downloaded yet
2026-03-28 10:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_83ade1a30b6679c06bdc239c78ad23f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_83ade1a30b6679c06bdc239c78ad23f9.jpg not downloaded yet
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_6d561cf3fe00bf21a195e886a8413add.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_6d561cf3fe00bf21a195e886a8413add.jpg not downloaded yet
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_83bc64290db2d75ca438c4b786d9931b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_83bc64290db2d75ca438c4b786d9931b.jpg not downloaded yet
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_8133cd3dcb61b91fab68459f3ad33475.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_8133cd3dcb61b91fab68459f3ad33475.jpg not downloaded yet
2026-03-28 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UT04321/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_8133cd3dcb61b91fab68459f3ad33475.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_83bc64290db2d75ca438c4b786d9931b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fd590>
2026-03-28 10:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_8133cd3dcb61b91fab68459f3ad33475.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_8133cd3dcb61b91fab68459f3ad33475.jpg saved to cache
2026-03-28 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f
2026-03-28 10:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8929410>
2026-03-28 10:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_83bc64290db2d75ca438c4b786d9931b.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_83bc64290db2d75ca438c4b786d9931b.jpg saved to cache
2026-03-28 10:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f
2026-03-28 10:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GA70819> (referer: https://www.auto1.com/v1/car-details-view/GA70819/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_6d561cf3fe00bf21a195e886a8413add.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819
2026-03-28 10:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0b4b5c2-ce85-54ee-aa47-e670959110bd with scrape type 1
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_c18144ea39591512b3393153666556e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_c18144ea39591512b3393153666556e7.jpg not downloaded yet
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_75b16690dfa58bc88c34b1e64fcdaa1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_75b16690dfa58bc88c34b1e64fcdaa1a.jpg not downloaded yet
2026-03-28 10:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_83ade1a30b6679c06bdc239c78ad23f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_0c10d2f1b8079ef99f6af0353046085e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_0c10d2f1b8079ef99f6af0353046085e.jpg not downloaded yet
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_a18f92269c0a80b924a592cc9cc57ba3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_a18f92269c0a80b924a592cc9cc57ba3.jpg not downloaded yet
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_4b9eedb0125219c7b4ace33bf4b330ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_4b9eedb0125219c7b4ace33bf4b330ca.jpg not downloaded yet
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_30371cff81a2d3a99cabc67ae9ee61f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_30371cff81a2d3a99cabc67ae9ee61f6.jpg not downloaded yet
2026-03-28 10:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab890a110>
2026-03-28 10:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_6d561cf3fe00bf21a195e886a8413add.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_6d561cf3fe00bf21a195e886a8413add.jpg saved to cache
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_1a6a6994e48836637d797f7db3dfcfc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_1a6a6994e48836637d797f7db3dfcfc8.jpg not downloaded yet
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_17a4c931f1f4a72dc5b02644ba01b449.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_17a4c931f1f4a72dc5b02644ba01b449.jpg not downloaded yet
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_1d6a5dfc3726d1d4bf7e43964d087659.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_1d6a5dfc3726d1d4bf7e43964d087659.jpg not downloaded yet
2026-03-28 10:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdc3490>
2026-03-28 10:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_83ade1a30b6679c06bdc239c78ad23f9.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_83ade1a30b6679c06bdc239c78ad23f9.jpg saved to cache
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_7521ebf1e5f62032d58c8e94c179f00d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_7521ebf1e5f62032d58c8e94c179f00d.jpg not downloaded yet
2026-03-28 10:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_75b16690dfa58bc88c34b1e64fcdaa1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5eb50>
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_75b16690dfa58bc88c34b1e64fcdaa1a.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_75b16690dfa58bc88c34b1e64fcdaa1a.jpg saved to cache
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_7521ebf1e5f62032d58c8e94c179f00d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef7a90>
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_7521ebf1e5f62032d58c8e94c179f00d.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_7521ebf1e5f62032d58c8e94c179f00d.jpg saved to cache
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_1d6a5dfc3726d1d4bf7e43964d087659.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LV05660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88c80d0>
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_1d6a5dfc3726d1d4bf7e43964d087659.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_1d6a5dfc3726d1d4bf7e43964d087659.jpg saved to cache
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_1a6a6994e48836637d797f7db3dfcfc8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_17a4c931f1f4a72dc5b02644ba01b449.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB42768> (referer: https://www.auto1.com/v1/car-details-view/GB42768/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe44cd0>
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_1a6a6994e48836637d797f7db3dfcfc8.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_1a6a6994e48836637d797f7db3dfcfc8.jpg saved to cache
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf68c10>
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_17a4c931f1f4a72dc5b02644ba01b449.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_17a4c931f1f4a72dc5b02644ba01b449.jpg saved to cache
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be1884f-0f13-53af-aee8-2672dd6d54d8 with identifier: GB42768
2026-03-28 10:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be1884f-0f13-53af-aee8-2672dd6d54d8 with scrape type 1
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6be1884f-0f13-53af-aee8-2672dd6d54d8
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_e4b230c25875ded639eb4c1a070939af.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_e4b230c25875ded639eb4c1a070939af.jpg already downloaded
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_8e634a130cfb65adc4127fa505dbbfbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_8e634a130cfb65adc4127fa505dbbfbd.jpg already downloaded
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_da2ad113ba055b689fe45250142d89a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_da2ad113ba055b689fe45250142d89a2.jpg already downloaded
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_c9c5b5856e21ea6b8ed57dd7dc411794.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_c9c5b5856e21ea6b8ed57dd7dc411794.jpg already downloaded
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_60dcdf09d9fbe669c1c29cd352a88e3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_60dcdf09d9fbe669c1c29cd352a88e3b.jpg already downloaded
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_521e8be915e8b9353db93c5bce811bcd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_521e8be915e8b9353db93c5bce811bcd.jpg already downloaded
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_8e27e1a6a200e162f079c8598df2a479.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_8e27e1a6a200e162f079c8598df2a479.jpg already downloaded
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_fe0eff8204d1c79a76c9cafac3903d34.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_fe0eff8204d1c79a76c9cafac3903d34.jpg already downloaded
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_d63e9b87367a03910bf4c351a452cc69.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_d63e9b87367a03910bf4c351a452cc69.jpg already downloaded
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F24%252F0a24a5f44e9c05496eaa4bfe4d58c0d5%252Fpa%252FGB42768_4c8b61f10d1b71e9e402ac2f89610a6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_4c8b61f10d1b71e9e402ac2f89610a6b.jpg already downloaded
2026-03-28 10:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6be1884f-0f13-53af-aee8-2672dd6d54d8, identifier: GB42768
2026-03-28 10:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6be1884f-0f13-53af-aee8-2672dd6d54d8 with identifier: GB42768
2026-03-28 10:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6be1884f-0f13-53af-aee8-2672dd6d54d8 with identifier: GB42768
2026-03-28 10:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6be1884f-0f13-53af-aee8-2672dd6d54d8 with identifier: GB42768 to the API
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GB42768>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:36Z',
 'fuel_type': 'petrol',
 'id': '6be1884f-0f13-53af-aee8-2672dd6d54d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB42768',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 76242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_e4b230c25875ded639eb4c1a070939af.jpg',
                'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_8e634a130cfb65adc4127fa505dbbfbd.jpg',
                'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_da2ad113ba055b689fe45250142d89a2.jpg',
                'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_c9c5b5856e21ea6b8ed57dd7dc411794.jpg',
                'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_60dcdf09d9fbe669c1c29cd352a88e3b.jpg',
                'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_521e8be915e8b9353db93c5bce811bcd.jpg',
                'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_8e27e1a6a200e162f079c8598df2a479.jpg',
                'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_fe0eff8204d1c79a76c9cafac3903d34.jpg',
                'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_d63e9b87367a03910bf4c351a452cc69.jpg',
                'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_4c8b61f10d1b71e9e402ac2f89610a6b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_e4b230c25875ded639eb4c1a070939af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_8e634a130cfb65adc4127fa505dbbfbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_da2ad113ba055b689fe45250142d89a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_c9c5b5856e21ea6b8ed57dd7dc411794.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2892776,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_60dcdf09d9fbe669c1c29cd352a88e3b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_521e8be915e8b9353db93c5bce811bcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2776599,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_8e27e1a6a200e162f079c8598df2a479.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_fe0eff8204d1c79a76c9cafac3903d34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977125,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_d63e9b87367a03910bf4c351a452cc69.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be1884f-0f13-53af-aee8-2672dd6d54d8/6be1884f-0f13-53af-aee8-2672dd6d54d8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/24/0a24a5f44e9c05496eaa4bfe4d58c0d5/pa/GB42768_4c8b61f10d1b71e9e402ac2f89610a6b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2020}
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB42768%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [auto1.de] INFO: Saving data for GB42768: {'created_time': 1774694380.306926, 'last_price_update_time': 1774694380.306936, 'auction_closing_time': 1774884756.0}
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB42768') HTTP/1.1" 204 0
2026-03-28 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_4b9eedb0125219c7b4ace33bf4b330ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC99241> (referer: https://www.auto1.com/v1/car-details-view/NC99241/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_30371cff81a2d3a99cabc67ae9ee61f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB94546/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_5092ec2f347b0b31b8776af38d58ccef.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd58dd0>
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_4b9eedb0125219c7b4ace33bf4b330ca.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_4b9eedb0125219c7b4ace33bf4b330ca.jpg saved to cache
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241
2026-03-28 10:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c133de-69fe-5e04-89d3-87045991704a with scrape type 1
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_9a34b9b913dba5555f5e17ec7d305b9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_9a34b9b913dba5555f5e17ec7d305b9f.jpg not downloaded yet
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_2d026ca06a30867d6372a547eaa93397.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_2d026ca06a30867d6372a547eaa93397.jpg not downloaded yet
2026-03-28 10:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_10b2b44060288b99dfcb513818506583.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd47450>
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_30371cff81a2d3a99cabc67ae9ee61f6.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_30371cff81a2d3a99cabc67ae9ee61f6.jpg saved to cache
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_635727acac373f5255c32399675431a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_635727acac373f5255c32399675431a6.jpg not downloaded yet
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_847fbf8bca5b0ff57942c1f86f248444.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_847fbf8bca5b0ff57942c1f86f248444.jpg not downloaded yet
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd9ded0>
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_5092ec2f347b0b31b8776af38d58ccef.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_5092ec2f347b0b31b8776af38d58ccef.jpg saved to cache
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf4cb90>
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg70%252F77%252F7077664e70ce30007fbd26aa11580602%252Fpa%252FBF02767_10b2b44060288b99dfcb513818506583.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_10b2b44060288b99dfcb513818506583.jpg saved to cache
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f
2026-03-28 10:39:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f, skipping ID generation
2026-03-28 10:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with scrape type 1
2026-03-28 10:39:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2e60ed2-ad9a-5831-8ecb-e1819ca4806f sending to next pipeline
2026-03-28 10:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f, identifier: BF02767
2026-03-28 10:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767
2026-03-28 10:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767
2026-03-28 10:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2e60ed2-ad9a-5831-8ecb-e1819ca4806f with identifier: BF02767 to the API
2026-03-28 10:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_10b2b44060288b99dfcb513818506583.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:36:59Z',
 'fuel_type': 'diesel',
 'id': 'e2e60ed2-ad9a-5831-8ecb-e1819ca4806f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF02767',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 262237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_10b2b44060288b99dfcb513818506583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_5092ec2f347b0b31b8776af38d58ccef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_83ade1a30b6679c06bdc239c78ad23f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_6d561cf3fe00bf21a195e886a8413add.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_83bc64290db2d75ca438c4b786d9931b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e2e60ed2-ad9a-5831-8ecb-e1819ca4806f/e2e60ed2-ad9a-5831-8ecb-e1819ca4806f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img70/77/7077664e70ce30007fbd26aa11580602/pa/BF02767_8133cd3dcb61b91fab68459f3ad33475.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 TDCi Ghia',
 'transmission': 'manual',
 'trim': 'Ghia',
 'year': 2009}
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF02767%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [auto1.de] INFO: Saving data for BF02767: {'created_time': 1774694381.292843, 'last_price_update_time': 1774694381.292856, 'auction_closing_time': 1774885019.0}
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF02767') HTTP/1.1" 204 0
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_3eea586f6158d75e3e393bb33dadf0d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_3eea586f6158d75e3e393bb33dadf0d9.jpg not downloaded yet
2026-03-28 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_9a34b9b913dba5555f5e17ec7d305b9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_f69ae1351111f7f598434285c246a77f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_f69ae1351111f7f598434285c246a77f.jpg not downloaded yet
2026-03-28 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW14038> (referer: https://www.auto1.com/v1/car-details-view/CW14038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX00661> (referer: https://www.auto1.com/v1/car-details-view/HX00661/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RL77282/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_16572ec763a6e8022f38dd7632e5201c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_16572ec763a6e8022f38dd7632e5201c.jpg not downloaded yet
2026-03-28 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_003683cc95bf033e6d954cc76ab56434.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_003683cc95bf033e6d954cc76ab56434.jpg not downloaded yet
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_2432d85fb19860e031225e3feec5220a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_2432d85fb19860e031225e3feec5220a.jpg not downloaded yet
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_b86f1b0eae12befd25e5118cf62e69a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_b86f1b0eae12befd25e5118cf62e69a1.jpg not downloaded yet
2026-03-28 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_3eea586f6158d75e3e393bb33dadf0d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_635727acac373f5255c32399675431a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88a22d0>
2026-03-28 10:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_9a34b9b913dba5555f5e17ec7d305b9f.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_9a34b9b913dba5555f5e17ec7d305b9f.jpg saved to cache
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE96927/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038
2026-03-28 10:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cae082d-9655-5aa7-9ab3-984921733949 with scrape type 1
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_c22b89ecb1a5232b538894252a96b199.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_c22b89ecb1a5232b538894252a96b199.jpg not downloaded yet
2026-03-28 10:39:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661
2026-03-28 10:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8498033-940f-556b-8bb2-5d54e188ff29 with scrape type 1
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8498033-940f-556b-8bb2-5d54e188ff29
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_872d679936cd79c70be12c3d3870ea63.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_872d679936cd79c70be12c3d3870ea63.jpg already downloaded
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_e9e30dbb3251e3e34c5f05094b9ca043.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_e9e30dbb3251e3e34c5f05094b9ca043.jpg already downloaded
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_a16d1f3d2c24771298dcd971d345810d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_a16d1f3d2c24771298dcd971d345810d.jpg already downloaded
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_894cd22ce96dfa66dda55c42f49ad200.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_894cd22ce96dfa66dda55c42f49ad200.jpg already downloaded
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_74dcb95cb6880705690660451338c9da.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_74dcb95cb6880705690660451338c9da.jpg already downloaded
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_267e2a4d5797fbddde053d713378ea40.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_267e2a4d5797fbddde053d713378ea40.jpg already downloaded
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_acd38dcebe70a8b09e6c5fd6edcdf707.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_acd38dcebe70a8b09e6c5fd6edcdf707.jpg already downloaded
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_32b241d0070b6b6f1c5278e3f8932aea.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_32b241d0070b6b6f1c5278e3f8932aea.jpg already downloaded
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_3bd728ac1584c9e49d2da22bd7b3506f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_3bd728ac1584c9e49d2da22bd7b3506f.jpg already downloaded
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F5d%252F645d102df51496969d568cbb91d213aa%252Fpa%252FHX00661_58a83e2cfe0335c6dc6a4fd1a763f033.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_58a83e2cfe0335c6dc6a4fd1a763f033.jpg already downloaded
2026-03-28 10:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8498033-940f-556b-8bb2-5d54e188ff29, identifier: HX00661
2026-03-28 10:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661
2026-03-28 10:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661
2026-03-28 10:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8498033-940f-556b-8bb2-5d54e188ff29 with identifier: HX00661 to the API
2026-03-28 10:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HX00661>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:06Z',
 'fuel_type': 'petrol',
 'id': 'a8498033-940f-556b-8bb2-5d54e188ff29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX00661',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 67053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_872d679936cd79c70be12c3d3870ea63.jpg',
                'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_e9e30dbb3251e3e34c5f05094b9ca043.jpg',
                'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_a16d1f3d2c24771298dcd971d345810d.jpg',
                'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_894cd22ce96dfa66dda55c42f49ad200.jpg',
                'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_74dcb95cb6880705690660451338c9da.jpg',
                'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_267e2a4d5797fbddde053d713378ea40.jpg',
                'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_acd38dcebe70a8b09e6c5fd6edcdf707.jpg',
                'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_32b241d0070b6b6f1c5278e3f8932aea.jpg',
                'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_3bd728ac1584c9e49d2da22bd7b3506f.jpg',
                'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_58a83e2cfe0335c6dc6a4fd1a763f033.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79247,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_872d679936cd79c70be12c3d3870ea63.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_e9e30dbb3251e3e34c5f05094b9ca043.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_a16d1f3d2c24771298dcd971d345810d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_894cd22ce96dfa66dda55c42f49ad200.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_74dcb95cb6880705690660451338c9da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_267e2a4d5797fbddde053d713378ea40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_acd38dcebe70a8b09e6c5fd6edcdf707.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86631,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_32b241d0070b6b6f1c5278e3f8932aea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_3bd728ac1584c9e49d2da22bd7b3506f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8498033-940f-556b-8bb2-5d54e188ff29/a8498033-940f-556b-8bb2-5d54e188ff29_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/5d/645d102df51496969d568cbb91d213aa/pa/HX00661_58a83e2cfe0335c6dc6a4fd1a763f033.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00661%27 HTTP/1.1" 200 None
2026-03-28 10:39:42 [auto1.de] INFO: Saving data for HX00661: {'created_time': 1774694382.226068, 'last_price_update_time': 1774694382.226082, 'auction_closing_time': 1774885386.0}
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX00661') HTTP/1.1" 204 0
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_c18144ea39591512b3393153666556e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_b26979cce913a2ccb6325f88b03149b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_b26979cce913a2ccb6325f88b03149b6.jpg not downloaded yet
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_b86f1b0eae12befd25e5118cf62e69a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_847fbf8bca5b0ff57942c1f86f248444.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_f69ae1351111f7f598434285c246a77f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_2432d85fb19860e031225e3feec5220a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd4d5d0>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_3eea586f6158d75e3e393bb33dadf0d9.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_3eea586f6158d75e3e393bb33dadf0d9.jpg saved to cache
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf89510>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_635727acac373f5255c32399675431a6.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_635727acac373f5255c32399675431a6.jpg saved to cache
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_a04ef5ff85548c14a6762c63e249fd97.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_a04ef5ff85548c14a6762c63e249fd97.jpg not downloaded yet
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_0c10d2f1b8079ef99f6af0353046085e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_003683cc95bf033e6d954cc76ab56434.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_c3c4b7b05737db04bafedbd1cb4b6111.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_c3c4b7b05737db04bafedbd1cb4b6111.jpg not downloaded yet
2026-03-28 10:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88e7790>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_c18144ea39591512b3393153666556e7.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_c18144ea39591512b3393153666556e7.jpg saved to cache
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_a18f92269c0a80b924a592cc9cc57ba3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_16572ec763a6e8022f38dd7632e5201c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_bdd0ce095ca6a120c350d659cc0fca4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_bdd0ce095ca6a120c350d659cc0fca4a.jpg not downloaded yet
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeb1fd0>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_b86f1b0eae12befd25e5118cf62e69a1.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_b86f1b0eae12befd25e5118cf62e69a1.jpg saved to cache
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd25610>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_847fbf8bca5b0ff57942c1f86f248444.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_847fbf8bca5b0ff57942c1f86f248444.jpg saved to cache
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe70ed0>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_f69ae1351111f7f598434285c246a77f.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_f69ae1351111f7f598434285c246a77f.jpg saved to cache
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5c710>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_2432d85fb19860e031225e3feec5220a.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_2432d85fb19860e031225e3feec5220a.jpg saved to cache
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_dbb60a967f76729d07e7561daa2d6d4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_dbb60a967f76729d07e7561daa2d6d4b.jpg not downloaded yet
2026-03-28 10:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_2d026ca06a30867d6372a547eaa93397.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdfd250>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_0c10d2f1b8079ef99f6af0353046085e.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_0c10d2f1b8079ef99f6af0353046085e.jpg saved to cache
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabeb0ad0>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_003683cc95bf033e6d954cc76ab56434.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_003683cc95bf033e6d954cc76ab56434.jpg saved to cache
2026-03-28 10:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a023d0>
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252Fda%252Fe3dad2e1eedd6d739a9ead806c73e3b6%252Fpa%252FGA70819_a18f92269c0a80b924a592cc9cc57ba3.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_a18f92269c0a80b924a592cc9cc57ba3.jpg saved to cache
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0b4b5c2-ce85-54ee-aa47-e670959110bd
2026-03-28 10:39:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0b4b5c2-ce85-54ee-aa47-e670959110bd, skipping ID generation
2026-03-28 10:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0b4b5c2-ce85-54ee-aa47-e670959110bd with scrape type 1
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0b4b5c2-ce85-54ee-aa47-e670959110bd sending to next pipeline
2026-03-28 10:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0b4b5c2-ce85-54ee-aa47-e670959110bd, identifier: GA70819
2026-03-28 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfbdad0>
2026-03-28 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_16572ec763a6e8022f38dd7632e5201c.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_16572ec763a6e8022f38dd7632e5201c.jpg saved to cache
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_7d8791a0e9770463f5d73d2849ae476d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_7d8791a0e9770463f5d73d2849ae476d.jpg not downloaded yet
2026-03-28 10:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819
2026-03-28 10:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819
2026-03-28 10:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0b4b5c2-ce85-54ee-aa47-e670959110bd with identifier: GA70819 to the API
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_a18f92269c0a80b924a592cc9cc57ba3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:22:35Z',
 'fuel_type': 'petrol',
 'id': 'f0b4b5c2-ce85-54ee-aa47-e670959110bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA70819',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 142807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3028887,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_c18144ea39591512b3393153666556e7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_75b16690dfa58bc88c34b1e64fcdaa1a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017501,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_0c10d2f1b8079ef99f6af0353046085e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2663809,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_a18f92269c0a80b924a592cc9cc57ba3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_4b9eedb0125219c7b4ace33bf4b330ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3044034,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_30371cff81a2d3a99cabc67ae9ee61f6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_1a6a6994e48836637d797f7db3dfcfc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_17a4c931f1f4a72dc5b02644ba01b449.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011173,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_1d6a5dfc3726d1d4bf7e43964d087659.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f0b4b5c2-ce85-54ee-aa47-e670959110bd/f0b4b5c2-ce85-54ee-aa47-e670959110bd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3076177,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/da/e3dad2e1eedd6d739a9ead806c73e3b6/pa/GA70819_7521ebf1e5f62032d58c8e94c179f00d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda CR-V 2.0 i-VTEC Lifestyle 4WD',
 'transmission': 'automatic',
 'trim': 'Lifestyle 4WD',
 'year': 2018}
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-28 10:39:43 [auto1.de] INFO: Saving data for GA70819: {'created_time': 1774694383.603959, 'last_price_update_time': 1774694383.603971, 'auction_closing_time': 1774884155.0}
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA70819') HTTP/1.1" 204 0
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_23313a9de13febf2504a4d979dfca4ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_23313a9de13febf2504a4d979dfca4ec.jpg not downloaded yet
2026-03-28 10:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ea650>
2026-03-28 10:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fbc%252Fcdbc9fb2ae0bff2c70126505e1b3f92e%252Fpa%252FNC99241_2d026ca06a30867d6372a547eaa93397.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_2d026ca06a30867d6372a547eaa93397.jpg saved to cache
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5c133de-69fe-5e04-89d3-87045991704a
2026-03-28 10:39:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5c133de-69fe-5e04-89d3-87045991704a, skipping ID generation
2026-03-28 10:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c133de-69fe-5e04-89d3-87045991704a with scrape type 1
2026-03-28 10:39:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5c133de-69fe-5e04-89d3-87045991704a sending to next pipeline
2026-03-28 10:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5c133de-69fe-5e04-89d3-87045991704a, identifier: NC99241
2026-03-28 10:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241
2026-03-28 10:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241
2026-03-28 10:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5c133de-69fe-5e04-89d3-87045991704a with identifier: NC99241 to the API
2026-03-28 10:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_2d026ca06a30867d6372a547eaa93397.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:36:23Z',
 'fuel_type': 'petrol',
 'id': 'c5c133de-69fe-5e04-89d3-87045991704a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC99241',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 218884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_9a34b9b913dba5555f5e17ec7d305b9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_2d026ca06a30867d6372a547eaa93397.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_635727acac373f5255c32399675431a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_847fbf8bca5b0ff57942c1f86f248444.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_3eea586f6158d75e3e393bb33dadf0d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_f69ae1351111f7f598434285c246a77f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_16572ec763a6e8022f38dd7632e5201c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_003683cc95bf033e6d954cc76ab56434.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_2432d85fb19860e031225e3feec5220a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5c133de-69fe-5e04-89d3-87045991704a/c5c133de-69fe-5e04-89d3-87045991704a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/bc/cdbc9fb2ae0bff2c70126505e1b3f92e/pa/NC99241_b86f1b0eae12befd25e5118cf62e69a1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2012}
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC99241%27 HTTP/1.1" 200 None
2026-03-28 10:39:44 [auto1.de] INFO: Saving data for NC99241: {'created_time': 1774694384.193912, 'last_price_update_time': 1774694384.193924, 'auction_closing_time': 1774884983.0}
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC99241') HTTP/1.1" 204 0
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_9a6fe32c695336927587171dbc4cdc2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_9a6fe32c695336927587171dbc4cdc2f.jpg not downloaded yet
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_d2196bf3e4e5d8436e6e36d269774b1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_d2196bf3e4e5d8436e6e36d269774b1f.jpg not downloaded yet
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_c22b89ecb1a5232b538894252a96b199.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_bdd0ce095ca6a120c350d659cc0fca4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_c3c4b7b05737db04bafedbd1cb4b6111.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe9ae90>
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_c22b89ecb1a5232b538894252a96b199.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_c22b89ecb1a5232b538894252a96b199.jpg saved to cache
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_dbb60a967f76729d07e7561daa2d6d4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_7d8791a0e9770463f5d73d2849ae476d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_9a6fe32c695336927587171dbc4cdc2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88e9250>
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_bdd0ce095ca6a120c350d659cc0fca4a.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_bdd0ce095ca6a120c350d659cc0fca4a.jpg saved to cache
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe2bb10>
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_c3c4b7b05737db04bafedbd1cb4b6111.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_c3c4b7b05737db04bafedbd1cb4b6111.jpg saved to cache
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe8fdd0>
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_dbb60a967f76729d07e7561daa2d6d4b.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_dbb60a967f76729d07e7561daa2d6d4b.jpg saved to cache
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb4350>
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_7d8791a0e9770463f5d73d2849ae476d.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_7d8791a0e9770463f5d73d2849ae476d.jpg saved to cache
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba7e4110>
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_9a6fe32c695336927587171dbc4cdc2f.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_9a6fe32c695336927587171dbc4cdc2f.jpg saved to cache
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_a04ef5ff85548c14a6762c63e249fd97.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_d2196bf3e4e5d8436e6e36d269774b1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_b26979cce913a2ccb6325f88b03149b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_23313a9de13febf2504a4d979dfca4ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf88850>
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_a04ef5ff85548c14a6762c63e249fd97.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_a04ef5ff85548c14a6762c63e249fd97.jpg saved to cache
2026-03-28 10:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe1e150>
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_d2196bf3e4e5d8436e6e36d269774b1f.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_d2196bf3e4e5d8436e6e36d269774b1f.jpg saved to cache
2026-03-28 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ff450>
2026-03-28 10:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_b26979cce913a2ccb6325f88b03149b6.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_b26979cce913a2ccb6325f88b03149b6.jpg saved to cache
2026-03-28 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb4650>
2026-03-28 10:39:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F92%252F6d92db1ddca48ad89f89a4f732da44b9%252Fpa%252FCW14038_23313a9de13febf2504a4d979dfca4ec.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_23313a9de13febf2504a4d979dfca4ec.jpg saved to cache
2026-03-28 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cae082d-9655-5aa7-9ab3-984921733949
2026-03-28 10:39:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cae082d-9655-5aa7-9ab3-984921733949, skipping ID generation
2026-03-28 10:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cae082d-9655-5aa7-9ab3-984921733949 with scrape type 1
2026-03-28 10:39:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cae082d-9655-5aa7-9ab3-984921733949 sending to next pipeline
2026-03-28 10:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cae082d-9655-5aa7-9ab3-984921733949, identifier: CW14038
2026-03-28 10:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038
2026-03-28 10:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038
2026-03-28 10:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cae082d-9655-5aa7-9ab3-984921733949 with identifier: CW14038 to the API
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_23313a9de13febf2504a4d979dfca4ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:48:35Z',
 'fuel_type': 'diesel',
 'id': '0cae082d-9655-5aa7-9ab3-984921733949',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW14038',
 'listing': 'auction',
 'location': 'DE, Trier',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 135660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3243530,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_c22b89ecb1a5232b538894252a96b199.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3189806,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_b26979cce913a2ccb6325f88b03149b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2921390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_a04ef5ff85548c14a6762c63e249fd97.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2888301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_c3c4b7b05737db04bafedbd1cb4b6111.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_bdd0ce095ca6a120c350d659cc0fca4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_dbb60a967f76729d07e7561daa2d6d4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_7d8791a0e9770463f5d73d2849ae476d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3008005,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_23313a9de13febf2504a4d979dfca4ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_9a6fe32c695336927587171dbc4cdc2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cae082d-9655-5aa7-9ab3-984921733949/0cae082d-9655-5aa7-9ab3-984921733949_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3055423,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/92/6d92db1ddca48ad89f89a4f732da44b9/pa/CW14038_d2196bf3e4e5d8436e6e36d269774b1f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2022}
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW14038%27 HTTP/1.1" 200 None
2026-03-28 10:39:45 [auto1.de] INFO: Saving data for CW14038: {'created_time': 1774694385.891554, 'last_price_update_time': 1774694385.891567, 'auction_closing_time': 1774885715.0}
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW14038') HTTP/1.1" 204 0
2026-03-28 10:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF72133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ47645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UT04321> (referer: https://www.auto1.com/v1/car-details-view/UT04321/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_4cf6fe82dacd25d3a2c1db8105508714.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321
2026-03-28 10:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8545ab6-db4b-5888-89bb-23f1749d14c9 with scrape type 1
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_126cdcc7febafd159fcf83a79f9c6d1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_126cdcc7febafd159fcf83a79f9c6d1d.jpg not downloaded yet
2026-03-28 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_bb92d4bad7e3a65bc3d31743fd7668af.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_0e638cfaf2df9a7a004a9cdc54a0beb8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_0e638cfaf2df9a7a004a9cdc54a0beb8.jpg not downloaded yet
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_15b439656ad918f37412b5f9bd24cddc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_15b439656ad918f37412b5f9bd24cddc.jpg not downloaded yet
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed5010>
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_4cf6fe82dacd25d3a2c1db8105508714.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_4cf6fe82dacd25d3a2c1db8105508714.jpg saved to cache
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_757ad1e426f3718d822d37c91c94ba27.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_757ad1e426f3718d822d37c91c94ba27.jpg not downloaded yet
2026-03-28 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_126cdcc7febafd159fcf83a79f9c6d1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_42d786713b2fb55ec99800946553a0cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_42d786713b2fb55ec99800946553a0cd.jpg not downloaded yet
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc23590>
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_bb92d4bad7e3a65bc3d31743fd7668af.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_bb92d4bad7e3a65bc3d31743fd7668af.jpg saved to cache
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_3a097387b4ea5739cc830b580530ea8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_3a097387b4ea5739cc830b580530ea8c.jpg not downloaded yet
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_ccab68ce2282aa3e700a5d0ba7c689c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_ccab68ce2282aa3e700a5d0ba7c689c6.jpg not downloaded yet
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_dcc4aac9fed5dcf2c5dc3a2c3d94652c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_dcc4aac9fed5dcf2c5dc3a2c3d94652c.jpg not downloaded yet
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe34bd0>
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_126cdcc7febafd159fcf83a79f9c6d1d.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_126cdcc7febafd159fcf83a79f9c6d1d.jpg saved to cache
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_3db9fa53f4cbb5c9876a65da10a2e7aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_3db9fa53f4cbb5c9876a65da10a2e7aa.jpg not downloaded yet
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_d0b04e6a882b46485e77f7fc6c02888c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_d0b04e6a882b46485e77f7fc6c02888c.jpg not downloaded yet
2026-03-28 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_757ad1e426f3718d822d37c91c94ba27.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf919d0>
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_757ad1e426f3718d822d37c91c94ba27.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_757ad1e426f3718d822d37c91c94ba27.jpg saved to cache
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_d0b04e6a882b46485e77f7fc6c02888c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88e9c50>
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_d0b04e6a882b46485e77f7fc6c02888c.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_d0b04e6a882b46485e77f7fc6c02888c.jpg saved to cache
2026-03-28 10:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_3db9fa53f4cbb5c9876a65da10a2e7aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfe2950>
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_3db9fa53f4cbb5c9876a65da10a2e7aa.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_3db9fa53f4cbb5c9876a65da10a2e7aa.jpg saved to cache
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_dcc4aac9fed5dcf2c5dc3a2c3d94652c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88a3610>
2026-03-28 10:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_dcc4aac9fed5dcf2c5dc3a2c3d94652c.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_dcc4aac9fed5dcf2c5dc3a2c3d94652c.jpg saved to cache
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RL77282> (referer: https://www.auto1.com/v1/car-details-view/RL77282/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_ccab68ce2282aa3e700a5d0ba7c689c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282
2026-03-28 10:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87990e2c-76dd-531a-9012-89b4b86f2f0c with scrape type 1
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87990e2c-76dd-531a-9012-89b4b86f2f0c
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_be59e3fb9c06d275c4bb7965ddf79da4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_be59e3fb9c06d275c4bb7965ddf79da4.jpg already downloaded
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_315b36565add54ba11c9024a595f6f33.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_315b36565add54ba11c9024a595f6f33.jpg already downloaded
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_ba39ce04bea5b4ca25bd4066db5e3c7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_ba39ce04bea5b4ca25bd4066db5e3c7d.jpg already downloaded
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_9ad97788de8e17e505b59125ea58652d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_9ad97788de8e17e505b59125ea58652d.jpg already downloaded
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_60bf88f1ea1e2b6055e20a62d688f09c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_60bf88f1ea1e2b6055e20a62d688f09c.jpg already downloaded
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_0836c96377fb525b7b352a360bb82a6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_0836c96377fb525b7b352a360bb82a6d.jpg already downloaded
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_b6c2791c888d9048ea8ef07374fdb8e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_b6c2791c888d9048ea8ef07374fdb8e1.jpg already downloaded
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_01f0cb52bd294a3f3e6f3fbafc58d2f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_01f0cb52bd294a3f3e6f3fbafc58d2f2.jpg already downloaded
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_9fc7d2aa285a79b142fd2f0ee526a3f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_9fc7d2aa285a79b142fd2f0ee526a3f5.jpg already downloaded
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimged%252Faf%252Fedaf7105d9f199a1c9fbc3addc38d9da%252Fpa%252FRL77282_558102d0a0ab49fdc4b34fddd01c3a0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_558102d0a0ab49fdc4b34fddd01c3a0e.jpg already downloaded
2026-03-28 10:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87990e2c-76dd-531a-9012-89b4b86f2f0c, identifier: RL77282
2026-03-28 10:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282
2026-03-28 10:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282
2026-03-28 10:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87990e2c-76dd-531a-9012-89b4b86f2f0c with identifier: RL77282 to the API
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RL77282>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:57:02Z',
 'fuel_type': 'petrol',
 'id': '87990e2c-76dd-531a-9012-89b4b86f2f0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL77282',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 55312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_be59e3fb9c06d275c4bb7965ddf79da4.jpg',
                'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_315b36565add54ba11c9024a595f6f33.jpg',
                'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_ba39ce04bea5b4ca25bd4066db5e3c7d.jpg',
                'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_9ad97788de8e17e505b59125ea58652d.jpg',
                'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_60bf88f1ea1e2b6055e20a62d688f09c.jpg',
                'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_0836c96377fb525b7b352a360bb82a6d.jpg',
                'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_b6c2791c888d9048ea8ef07374fdb8e1.jpg',
                'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_01f0cb52bd294a3f3e6f3fbafc58d2f2.jpg',
                'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_9fc7d2aa285a79b142fd2f0ee526a3f5.jpg',
                'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_558102d0a0ab49fdc4b34fddd01c3a0e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2636815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_be59e3fb9c06d275c4bb7965ddf79da4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519470,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_315b36565add54ba11c9024a595f6f33.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2273996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_ba39ce04bea5b4ca25bd4066db5e3c7d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2422553,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_9ad97788de8e17e505b59125ea58652d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2430714,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_60bf88f1ea1e2b6055e20a62d688f09c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2455952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_0836c96377fb525b7b352a360bb82a6d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2201393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_b6c2791c888d9048ea8ef07374fdb8e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2531865,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_01f0cb52bd294a3f3e6f3fbafc58d2f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2433224,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_9fc7d2aa285a79b142fd2f0ee526a3f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87990e2c-76dd-531a-9012-89b4b86f2f0c/87990e2c-76dd-531a-9012-89b4b86f2f0c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2415435,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imged/af/edaf7105d9f199a1c9fbc3addc38d9da/pa/RL77282_558102d0a0ab49fdc4b34fddd01c3a0e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL77282%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [auto1.de] INFO: Saving data for RL77282: {'created_time': 1774694388.097597, 'last_price_update_time': 1774694388.097607, 'auction_closing_time': 1774886222.0}
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL77282') HTTP/1.1" 204 0
2026-03-28 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_42d786713b2fb55ec99800946553a0cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89fa9d0>
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_ccab68ce2282aa3e700a5d0ba7c689c6.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_ccab68ce2282aa3e700a5d0ba7c689c6.jpg saved to cache
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE96927> (referer: https://www.auto1.com/v1/car-details-view/GE96927/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad5190>
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_42d786713b2fb55ec99800946553a0cd.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_42d786713b2fb55ec99800946553a0cd.jpg saved to cache
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_3a097387b4ea5739cc830b580530ea8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927
2026-03-28 10:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf15954-0fd3-575b-be4b-66e59f000b7e with scrape type 1
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_73a1b21785a64468c36c9ca98774ff58.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_73a1b21785a64468c36c9ca98774ff58.jpg not downloaded yet
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_533c96989138c96844818da5d8eba1ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_533c96989138c96844818da5d8eba1ab.jpg not downloaded yet
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_e0ef34c2ec4655bf1ded20241b10ff54.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e0ef34c2ec4655bf1ded20241b10ff54.jpg not downloaded yet
2026-03-28 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_15b439656ad918f37412b5f9bd24cddc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_e1fc70240dc54c1b55bb293ff0b6d030.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e1fc70240dc54c1b55bb293ff0b6d030.jpg not downloaded yet
2026-03-28 10:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ff290>
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_3a097387b4ea5739cc830b580530ea8c.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_3a097387b4ea5739cc830b580530ea8c.jpg saved to cache
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_1e8bb712d8f30c385c657b9d16aa11ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_1e8bb712d8f30c385c657b9d16aa11ba.jpg not downloaded yet
2026-03-28 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_0e638cfaf2df9a7a004a9cdc54a0beb8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_e176ec8c7144bf80de27af76b146de67.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e176ec8c7144bf80de27af76b146de67.jpg not downloaded yet
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda2790>
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_15b439656ad918f37412b5f9bd24cddc.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_15b439656ad918f37412b5f9bd24cddc.jpg saved to cache
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_dbb20bdaba50e31686a15eced97bd5a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_dbb20bdaba50e31686a15eced97bd5a6.jpg not downloaded yet
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_cad984df0e7819d10966aed8ca2ae421.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_cad984df0e7819d10966aed8ca2ae421.jpg not downloaded yet
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_75018bd6d10044423b4ba78d6c2db1b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_75018bd6d10044423b4ba78d6c2db1b9.jpg not downloaded yet
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_0bf99b90e519218bb07b999adf0fa417.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_0bf99b90e519218bb07b999adf0fa417.jpg not downloaded yet
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe1c6d0>
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg81%252Fdc%252F81dc8d2ea65aee29b2c9732954c84b32%252Fpa%252FUT04321_0e638cfaf2df9a7a004a9cdc54a0beb8.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_0e638cfaf2df9a7a004a9cdc54a0beb8.jpg saved to cache
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8545ab6-db4b-5888-89bb-23f1749d14c9
2026-03-28 10:39:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8545ab6-db4b-5888-89bb-23f1749d14c9, skipping ID generation
2026-03-28 10:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8545ab6-db4b-5888-89bb-23f1749d14c9 with scrape type 1
2026-03-28 10:39:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8545ab6-db4b-5888-89bb-23f1749d14c9 sending to next pipeline
2026-03-28 10:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8545ab6-db4b-5888-89bb-23f1749d14c9, identifier: UT04321
2026-03-28 10:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_1e8bb712d8f30c385c657b9d16aa11ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321
2026-03-28 10:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321
2026-03-28 10:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8545ab6-db4b-5888-89bb-23f1749d14c9 with identifier: UT04321 to the API
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_0e638cfaf2df9a7a004a9cdc54a0beb8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:03:04Z',
 'fuel_type': 'petrol',
 'id': 'f8545ab6-db4b-5888-89bb-23f1749d14c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT04321',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 126641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_126cdcc7febafd159fcf83a79f9c6d1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_0e638cfaf2df9a7a004a9cdc54a0beb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_15b439656ad918f37412b5f9bd24cddc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_757ad1e426f3718d822d37c91c94ba27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_42d786713b2fb55ec99800946553a0cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2320090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_3a097387b4ea5739cc830b580530ea8c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2308619,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_ccab68ce2282aa3e700a5d0ba7c689c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2392602,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_dcc4aac9fed5dcf2c5dc3a2c3d94652c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2825957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_3db9fa53f4cbb5c9876a65da10a2e7aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8545ab6-db4b-5888-89bb-23f1749d14c9/f8545ab6-db4b-5888-89bb-23f1749d14c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2490795,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img81/dc/81dc8d2ea65aee29b2c9732954c84b32/pa/UT04321_d0b04e6a882b46485e77f7fc6c02888c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 FIFA World Cup Edition 2WD',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition 2WD',
 'year': 2015}
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT04321%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [auto1.de] INFO: Saving data for UT04321: {'created_time': 1774694389.337467, 'last_price_update_time': 1774694389.337478, 'auction_closing_time': 1774882984.0}
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT04321') HTTP/1.1" 204 0
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed4250>
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_1e8bb712d8f30c385c657b9d16aa11ba.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_1e8bb712d8f30c385c657b9d16aa11ba.jpg saved to cache
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e0ef34c2ec4655bf1ded20241b10ff54.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_0bf99b90e519218bb07b999adf0fa417.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba7e4c50>
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_e0ef34c2ec4655bf1ded20241b10ff54.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e0ef34c2ec4655bf1ded20241b10ff54.jpg saved to cache
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_cad984df0e7819d10966aed8ca2ae421.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88a0950>
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_0bf99b90e519218bb07b999adf0fa417.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_0bf99b90e519218bb07b999adf0fa417.jpg saved to cache
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ37250> (referer: https://www.auto1.com/v1/car-details-view/UJ37250/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_75018bd6d10044423b4ba78d6c2db1b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd6d650>
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_cad984df0e7819d10966aed8ca2ae421.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_cad984df0e7819d10966aed8ca2ae421.jpg saved to cache
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e176ec8c7144bf80de27af76b146de67.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e1fc70240dc54c1b55bb293ff0b6d030.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250
2026-03-28 10:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e56a8417-1e7d-5bca-9a99-354592d7c3b9 with scrape type 1
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_f46d948261c1b026f80a67d1e2478ca8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_f46d948261c1b026f80a67d1e2478ca8.jpg not downloaded yet
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_46a571f8ce5e13ef6c9d970256ba07f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_46a571f8ce5e13ef6c9d970256ba07f5.jpg not downloaded yet
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_1109578dd454673dbb508d4a51b626e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_1109578dd454673dbb508d4a51b626e9.jpg not downloaded yet
2026-03-28 10:39:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88dc290>
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_75018bd6d10044423b4ba78d6c2db1b9.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_75018bd6d10044423b4ba78d6c2db1b9.jpg saved to cache
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_b1b153402a2f1e3323af23ffa80682fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_b1b153402a2f1e3323af23ffa80682fa.jpg not downloaded yet
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88a0810>
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_e176ec8c7144bf80de27af76b146de67.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e176ec8c7144bf80de27af76b146de67.jpg saved to cache
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc4e90>
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_e1fc70240dc54c1b55bb293ff0b6d030.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e1fc70240dc54c1b55bb293ff0b6d030.jpg saved to cache
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_4c0314f4ab95b78d575bd787fa49b873.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_4c0314f4ab95b78d575bd787fa49b873.jpg not downloaded yet
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_a74f2ffc78e21f48b72a8718558b3e98.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_a74f2ffc78e21f48b72a8718558b3e98.jpg not downloaded yet
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_a31e6c8361ba64f924deeffe17d2faf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_a31e6c8361ba64f924deeffe17d2faf0.jpg not downloaded yet
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_372db3e3f57071125e630e1db9f2a854.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_372db3e3f57071125e630e1db9f2a854.jpg not downloaded yet
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_14e0ab66d6cda3f21ad80192947609ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_14e0ab66d6cda3f21ad80192947609ed.jpg not downloaded yet
2026-03-28 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_dbb20bdaba50e31686a15eced97bd5a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_4a8513de962064607f7965606720e603.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_4a8513de962064607f7965606720e603.jpg not downloaded yet
2026-03-28 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_533c96989138c96844818da5d8eba1ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_73a1b21785a64468c36c9ca98774ff58.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB94546> (referer: https://www.auto1.com/v1/car-details-view/WB94546/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd6ebd0>
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_dbb20bdaba50e31686a15eced97bd5a6.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_dbb20bdaba50e31686a15eced97bd5a6.jpg saved to cache
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe98890>
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_533c96989138c96844818da5d8eba1ab.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_533c96989138c96844818da5d8eba1ab.jpg saved to cache
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5a950>
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4d%252F28%252F4d283d12adb0f86be256d7d2899ae4aa%252Fpa%252FGE96927_73a1b21785a64468c36c9ca98774ff58.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_73a1b21785a64468c36c9ca98774ff58.jpg saved to cache
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8bf15954-0fd3-575b-be4b-66e59f000b7e
2026-03-28 10:39:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8bf15954-0fd3-575b-be4b-66e59f000b7e, skipping ID generation
2026-03-28 10:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bf15954-0fd3-575b-be4b-66e59f000b7e with scrape type 1
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8bf15954-0fd3-575b-be4b-66e59f000b7e sending to next pipeline
2026-03-28 10:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bf15954-0fd3-575b-be4b-66e59f000b7e, identifier: GE96927
2026-03-28 10:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546
2026-03-28 10:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60158439-dfbb-5db0-9278-aab9484e26aa with scrape type 1
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_cf2b64ff3fa14f72bd28843e71a21e47.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_cf2b64ff3fa14f72bd28843e71a21e47.jpg not downloaded yet
2026-03-28 10:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927
2026-03-28 10:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927
2026-03-28 10:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bf15954-0fd3-575b-be4b-66e59f000b7e with identifier: GE96927 to the API
2026-03-28 10:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_73a1b21785a64468c36c9ca98774ff58.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:50:26Z',
 'fuel_type': 'petrol',
 'id': '8bf15954-0fd3-575b-be4b-66e59f000b7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE96927',
 'listing': 'auction',
 'location': 'DE, Aachen',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 161103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2348160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_73a1b21785a64468c36c9ca98774ff58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2078945,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_533c96989138c96844818da5d8eba1ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2038692,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e0ef34c2ec4655bf1ded20241b10ff54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e1fc70240dc54c1b55bb293ff0b6d030.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_1e8bb712d8f30c385c657b9d16aa11ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_e176ec8c7144bf80de27af76b146de67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1976013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_dbb20bdaba50e31686a15eced97bd5a6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_cad984df0e7819d10966aed8ca2ae421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2313369,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_75018bd6d10044423b4ba78d6c2db1b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8bf15954-0fd3-575b-be4b-66e59f000b7e/8bf15954-0fd3-575b-be4b-66e59f000b7e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2397973,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4d/28/4d283d12adb0f86be256d7d2899ae4aa/pa/GE96927_0bf99b90e519218bb07b999adf0fa417.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [auto1.de] INFO: Saving data for GE96927: {'created_time': 1774694391.159504, 'last_price_update_time': 1774694391.159515, 'auction_closing_time': 1774885826.0}
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE96927') HTTP/1.1" 204 0
2026-03-28 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_4a8513de962064607f7965606720e603.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_a033ab0da646d353cfd438bd71883bd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_a033ab0da646d353cfd438bd71883bd3.jpg not downloaded yet
2026-03-28 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_a31e6c8361ba64f924deeffe17d2faf0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_4efc3e12c54c0a71eca724c58f3a3265.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_4efc3e12c54c0a71eca724c58f3a3265.jpg not downloaded yet
2026-03-28 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ08958> (referer: https://www.auto1.com/v1/car-details-view/GJ08958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RG68419> (referer: https://www.auto1.com/v1/car-details-view/RG68419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LV05660> (referer: https://www.auto1.com/v1/car-details-view/LV05660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_a05b4819a3f7e871713c7296642ee715.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_a05b4819a3f7e871713c7296642ee715.jpg not downloaded yet
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_ad869b324cafd33a01afa909cdd68102.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_ad869b324cafd33a01afa909cdd68102.jpg not downloaded yet
2026-03-28 10:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd5b010>
2026-03-28 10:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_4a8513de962064607f7965606720e603.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_4a8513de962064607f7965606720e603.jpg saved to cache
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_f72e52b76dbab285cdb2763f4244ab31.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_f72e52b76dbab285cdb2763f4244ab31.jpg not downloaded yet
2026-03-28 10:39:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_cf2b64ff3fa14f72bd28843e71a21e47.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfbf0d0>
2026-03-28 10:39:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_a31e6c8361ba64f924deeffe17d2faf0.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_a31e6c8361ba64f924deeffe17d2faf0.jpg saved to cache
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_2626eca6bbc3bca3147a3e3d53d4ea8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_2626eca6bbc3bca3147a3e3d53d4ea8a.jpg not downloaded yet
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_28a949f93312449519b8a10fee163e36.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_28a949f93312449519b8a10fee163e36.jpg not downloaded yet
2026-03-28 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958
2026-03-28 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f6bdfff-f77d-502c-908b-e8357da2500d with scrape type 1
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_b348428c0ad3194da9a38aec873fced1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_b348428c0ad3194da9a38aec873fced1.jpg not downloaded yet
2026-03-28 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419
2026-03-28 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe with scrape type 1
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_261197f7eb1000b6684dfe2f9d23af92.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_261197f7eb1000b6684dfe2f9d23af92.jpg not downloaded yet
2026-03-28 10:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660
2026-03-28 10:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 889dd955-08a4-5d8a-83ea-3ce96c103f89 with scrape type 1
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 889dd955-08a4-5d8a-83ea-3ce96c103f89
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_3ed1a1f308423413ed7540be536104be.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_3ed1a1f308423413ed7540be536104be.jpg already downloaded
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_03efd78fbd397a46f45fc4fab492adc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_03efd78fbd397a46f45fc4fab492adc0.jpg already downloaded
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_1aa1d05e3a65ca55b22ccd571aff387b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_1aa1d05e3a65ca55b22ccd571aff387b.jpg already downloaded
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_1558692b013ad96fcfe813a11143d404.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_1558692b013ad96fcfe813a11143d404.jpg already downloaded
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_8fa67e1227e733c25afdf41d4bfc2250.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_8fa67e1227e733c25afdf41d4bfc2250.jpg already downloaded
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_c72a3cb7124fc21481c791b6210a5692.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_c72a3cb7124fc21481c791b6210a5692.jpg already downloaded
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_d20d9e53451a314fb78d75452e156e32.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_d20d9e53451a314fb78d75452e156e32.jpg already downloaded
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_4543eefe3d5d52c15fa871863422410e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_4543eefe3d5d52c15fa871863422410e.jpg already downloaded
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_bbd25202ac00affc4378906202b1b62c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_bbd25202ac00affc4378906202b1b62c.jpg already downloaded
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F44%252F85443e4b719e9e3fda664e256703a105%252Fpa%252FLV05660_94a3a9d6d50f22f3c3ebb2a394e746f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_94a3a9d6d50f22f3c3ebb2a394e746f1.jpg already downloaded
2026-03-28 10:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 889dd955-08a4-5d8a-83ea-3ce96c103f89, identifier: LV05660
2026-03-28 10:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660
2026-03-28 10:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660
2026-03-28 10:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 889dd955-08a4-5d8a-83ea-3ce96c103f89 with identifier: LV05660 to the API
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LV05660>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:00:40Z',
 'fuel_type': 'diesel',
 'id': '889dd955-08a4-5d8a-83ea-3ce96c103f89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV05660',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 55168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 34,
 'photo_urls': ['https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_3ed1a1f308423413ed7540be536104be.jpg',
                'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_03efd78fbd397a46f45fc4fab492adc0.jpg',
                'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_1aa1d05e3a65ca55b22ccd571aff387b.jpg',
                'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_1558692b013ad96fcfe813a11143d404.jpg',
                'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_8fa67e1227e733c25afdf41d4bfc2250.jpg',
                'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_c72a3cb7124fc21481c791b6210a5692.jpg',
                'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_d20d9e53451a314fb78d75452e156e32.jpg',
                'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_4543eefe3d5d52c15fa871863422410e.jpg',
                'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_bbd25202ac00affc4378906202b1b62c.jpg',
                'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_94a3a9d6d50f22f3c3ebb2a394e746f1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3054257,
             'Height': 3024,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_3ed1a1f308423413ed7540be536104be.jpg',
             'Width': 4032},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_03efd78fbd397a46f45fc4fab492adc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_1aa1d05e3a65ca55b22ccd571aff387b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_1558692b013ad96fcfe813a11143d404.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_8fa67e1227e733c25afdf41d4bfc2250.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_c72a3cb7124fc21481c791b6210a5692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_d20d9e53451a314fb78d75452e156e32.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_4543eefe3d5d52c15fa871863422410e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_bbd25202ac00affc4378906202b1b62c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_889dd955-08a4-5d8a-83ea-3ce96c103f89/889dd955-08a4-5d8a-83ea-3ce96c103f89_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/44/85443e4b719e9e3fda664e256703a105/pa/LV05660_94a3a9d6d50f22f3c3ebb2a394e746f1.jpg',
             'Width': 450}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-13',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Toyota ProAce 2.0 D-4D L2 Kasten Meister',
 'transmission': 'manual',
 'trim': 'L2 Kasten Meister',
 'year': 2020}
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV05660%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [auto1.de] INFO: Saving data for LV05660: {'created_time': 1774694392.088947, 'last_price_update_time': 1774694392.088958, 'auction_closing_time': 1774882840.0}
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV05660') HTTP/1.1" 204 0
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_79d8e3b46d6894c44dde71d76500bce7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_79d8e3b46d6894c44dde71d76500bce7.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_5f8707b4db1137fc44a62fa874cf5fe6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_5f8707b4db1137fc44a62fa874cf5fe6.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_ae176565cddb6a022e36d3a82ea65a38.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_ae176565cddb6a022e36d3a82ea65a38.jpg not downloaded yet
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_4c0314f4ab95b78d575bd787fa49b873.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_ad869b324cafd33a01afa909cdd68102.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_6414939ef591054ef205eb472dbc66d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_6414939ef591054ef205eb472dbc66d7.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_a5c8c74d03dc9f60eea548719d321183.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_a5c8c74d03dc9f60eea548719d321183.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_1d916c8082f16659204eaa0154c27df8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_1d916c8082f16659204eaa0154c27df8.jpg not downloaded yet
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf59f10>
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_cf2b64ff3fa14f72bd28843e71a21e47.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_cf2b64ff3fa14f72bd28843e71a21e47.jpg saved to cache
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_372db3e3f57071125e630e1db9f2a854.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_e6845b0dc83ed136ec50c0195fb8f8a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_e6845b0dc83ed136ec50c0195fb8f8a2.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_b194561dea1338a4253a508e12fee8bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_b194561dea1338a4253a508e12fee8bf.jpg not downloaded yet
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR31578/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_4d3ba953e28616b3d6feb2dfdabeb65c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_4d3ba953e28616b3d6feb2dfdabeb65c.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_a899a5d5157507dde99ef6df56e54e99.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_a899a5d5157507dde99ef6df56e54e99.jpg not downloaded yet
2026-03-28 10:39:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabee0110>
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_4c0314f4ab95b78d575bd787fa49b873.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_4c0314f4ab95b78d575bd787fa49b873.jpg saved to cache
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f2f90>
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_ad869b324cafd33a01afa909cdd68102.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_ad869b324cafd33a01afa909cdd68102.jpg saved to cache
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_5f8707b4db1137fc44a62fa874cf5fe6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_bf4c726910a65ecf8fd14546fbf7c97b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_bf4c726910a65ecf8fd14546fbf7c97b.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_ecc72888b010ea1a0c04fbccd52633db.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_ecc72888b010ea1a0c04fbccd52633db.jpg not downloaded yet
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_ae176565cddb6a022e36d3a82ea65a38.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_2a4f1c9bf153439c80bb4aa1a3d7deab.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_2a4f1c9bf153439c80bb4aa1a3d7deab.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_2e2143c3b8636575cce9d4f846074031.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_2e2143c3b8636575cce9d4f846074031.jpg not downloaded yet
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF41650> (referer: https://www.auto1.com/v1/car-details-view/MF41650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfe3610>
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_372db3e3f57071125e630e1db9f2a854.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_372db3e3f57071125e630e1db9f2a854.jpg saved to cache
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_6dcff0ce5e0ad1625a07af7514834161.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_6dcff0ce5e0ad1625a07af7514834161.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_b71f4533af8a66d7db1ef7d7c8b23373.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_b71f4533af8a66d7db1ef7d7c8b23373.jpg not downloaded yet
2026-03-28 10:39:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_79d8e3b46d6894c44dde71d76500bce7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_a899a5d5157507dde99ef6df56e54e99.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_3d5826e35eb7c9c3522d005a3e8379f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_3d5826e35eb7c9c3522d005a3e8379f7.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_273234773805f4dc14cc763478d7b262.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_273234773805f4dc14cc763478d7b262.jpg not downloaded yet
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc5b50>
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_5f8707b4db1137fc44a62fa874cf5fe6.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_5f8707b4db1137fc44a62fa874cf5fe6.jpg saved to cache
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabed6410>
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_ae176565cddb6a022e36d3a82ea65a38.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_ae176565cddb6a022e36d3a82ea65a38.jpg saved to cache
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650
2026-03-28 10:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with scrape type 1
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_39d9bd4423d7659f438239192a7788a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_39d9bd4423d7659f438239192a7788a5.jpg not downloaded yet
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_4d3ba953e28616b3d6feb2dfdabeb65c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_59adf173e1af7d918cd45d9d7a6258be.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_59adf173e1af7d918cd45d9d7a6258be.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_80791a5d319aedec57316d3e9182bc6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_80791a5d319aedec57316d3e9182bc6d.jpg not downloaded yet
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_039c8901d9e5b3d06859b5dad09e5be6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_039c8901d9e5b3d06859b5dad09e5be6.jpg not downloaded yet
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe44cd0>
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_79d8e3b46d6894c44dde71d76500bce7.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_79d8e3b46d6894c44dde71d76500bce7.jpg saved to cache
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfb9ad0>
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_a899a5d5157507dde99ef6df56e54e99.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_a899a5d5157507dde99ef6df56e54e99.jpg saved to cache
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_4594debaaefb392c62f2aea5d90951ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_4594debaaefb392c62f2aea5d90951ad.jpg not downloaded yet
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_2e2143c3b8636575cce9d4f846074031.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_2a4f1c9bf153439c80bb4aa1a3d7deab.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_b71f4533af8a66d7db1ef7d7c8b23373.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_97b8a253bf9354b83eae8c25490549e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_97b8a253bf9354b83eae8c25490549e2.jpg not downloaded yet
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ace90>
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_4d3ba953e28616b3d6feb2dfdabeb65c.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_4d3ba953e28616b3d6feb2dfdabeb65c.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_d662feed873b4e1dc7631e470931a33e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_d662feed873b4e1dc7631e470931a33e.jpg not downloaded yet
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_80791a5d319aedec57316d3e9182bc6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_53364a024222fa581aff7ac2040bf752.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_53364a024222fa581aff7ac2040bf752.jpg not downloaded yet
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad7750>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_2e2143c3b8636575cce9d4f846074031.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_2e2143c3b8636575cce9d4f846074031.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd53290>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_2a4f1c9bf153439c80bb4aa1a3d7deab.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_2a4f1c9bf153439c80bb4aa1a3d7deab.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_14e0ab66d6cda3f21ad80192947609ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_87b94c80ce12dcfb99171c86fd0f6c68.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_87b94c80ce12dcfb99171c86fd0f6c68.jpg not downloaded yet
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88e83d0>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_b71f4533af8a66d7db1ef7d7c8b23373.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_b71f4533af8a66d7db1ef7d7c8b23373.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_039c8901d9e5b3d06859b5dad09e5be6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_687eee5150d628974057470b8a301c16.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_687eee5150d628974057470b8a301c16.jpg not downloaded yet
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN77870> (referer: https://www.auto1.com/v1/car-details-view/JN77870/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_4594debaaefb392c62f2aea5d90951ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf70bd0>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_80791a5d319aedec57316d3e9182bc6d.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_80791a5d319aedec57316d3e9182bc6d.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_53d9e04ec6da93a350f87d01ffdca5af.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_53d9e04ec6da93a350f87d01ffdca5af.jpg not downloaded yet
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_9cbadb84ff6de8e921852bbd99c7957e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_9cbadb84ff6de8e921852bbd99c7957e.jpg not downloaded yet
2026-03-28 10:39:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88dc390>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_14e0ab66d6cda3f21ad80192947609ed.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_14e0ab66d6cda3f21ad80192947609ed.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_d662feed873b4e1dc7631e470931a33e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_a74f2ffc78e21f48b72a8718558b3e98.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabff6450>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_039c8901d9e5b3d06859b5dad09e5be6.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_039c8901d9e5b3d06859b5dad09e5be6.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870
2026-03-28 10:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with scrape type 1
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_ec7b0741cbab02a964a7a1f20a627253.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_ec7b0741cbab02a964a7a1f20a627253.jpg not downloaded yet
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fca50>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_4594debaaefb392c62f2aea5d90951ad.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_4594debaaefb392c62f2aea5d90951ad.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_87b94c80ce12dcfb99171c86fd0f6c68.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_97b8a253bf9354b83eae8c25490549e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_cc803b421162224c58c4ece2535ef672.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_cc803b421162224c58c4ece2535ef672.jpg not downloaded yet
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_59adf173e1af7d918cd45d9d7a6258be.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR37862> (referer: https://www.auto1.com/v1/car-details-view/AR37862/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_a033ab0da646d353cfd438bd71883bd3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_311fc812fdcba0b908899ab3a8d1a337.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_311fc812fdcba0b908899ab3a8d1a337.jpg not downloaded yet
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a18bd0>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_d662feed873b4e1dc7631e470931a33e.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_d662feed873b4e1dc7631e470931a33e.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd30c10>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_a74f2ffc78e21f48b72a8718558b3e98.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_a74f2ffc78e21f48b72a8718558b3e98.jpg saved to cache
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_0d8853aa3343311501e8c287440aea10.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_0d8853aa3343311501e8c287440aea10.jpg not downloaded yet
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_4efc3e12c54c0a71eca724c58f3a3265.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_ec7b0741cbab02a964a7a1f20a627253.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_53d9e04ec6da93a350f87d01ffdca5af.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_687eee5150d628974057470b8a301c16.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_612c52f7e0d9608f8390a62a1f33f2de.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_612c52f7e0d9608f8390a62a1f33f2de.jpg not downloaded yet
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF55649/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_be96839dd240ac9c5450b5d9141f88f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_be96839dd240ac9c5450b5d9141f88f9.jpg not downloaded yet
2026-03-28 10:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FN47599> (referer: https://www.auto1.com/v1/car-details-view/FN47599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89118d0>
2026-03-28 10:39:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_87b94c80ce12dcfb99171c86fd0f6c68.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_87b94c80ce12dcfb99171c86fd0f6c68.jpg saved to cache
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf68550>
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_97b8a253bf9354b83eae8c25490549e2.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_97b8a253bf9354b83eae8c25490549e2.jpg saved to cache
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd92e50>
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_59adf173e1af7d918cd45d9d7a6258be.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_59adf173e1af7d918cd45d9d7a6258be.jpg saved to cache
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862
2026-03-28 10:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be914301-f5ec-5d06-972c-f7e752f50444 with scrape type 1
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item be914301-f5ec-5d06-972c-f7e752f50444
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F31%252F8f3148b7781be822a89f7467e1331738%252Fpa%252FAR37862_bda49b471655f1cf1503f67362b4d46a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_bda49b471655f1cf1503f67362b4d46a.jpg already downloaded
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F31%252F8f3148b7781be822a89f7467e1331738%252Fpa%252FAR37862_5403335304e3592f15d5ffce71573252.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_5403335304e3592f15d5ffce71573252.jpg already downloaded
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F31%252F8f3148b7781be822a89f7467e1331738%252Fpa%252FAR37862_130bc1642f2d6fc3ba31c25c7f129fda.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_130bc1642f2d6fc3ba31c25c7f129fda.jpg already downloaded
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F31%252F8f3148b7781be822a89f7467e1331738%252Fpa%252FAR37862_4c243faee5f9661d7fef009b2a946bac.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_4c243faee5f9661d7fef009b2a946bac.jpg already downloaded
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F31%252F8f3148b7781be822a89f7467e1331738%252Fpa%252FAR37862_09c173705f9ef2b3eea730a18c32fca1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_09c173705f9ef2b3eea730a18c32fca1.jpg already downloaded
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F31%252F8f3148b7781be822a89f7467e1331738%252Fpa%252FAR37862_530ee01a3bcf96f707c7dba5071a70f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_530ee01a3bcf96f707c7dba5071a70f8.jpg already downloaded
2026-03-28 10:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be914301-f5ec-5d06-972c-f7e752f50444, identifier: AR37862
2026-03-28 10:39:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef0910>
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_a033ab0da646d353cfd438bd71883bd3.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_a033ab0da646d353cfd438bd71883bd3.jpg saved to cache
2026-03-28 10:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862
2026-03-28 10:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862
2026-03-28 10:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be914301-f5ec-5d06-972c-f7e752f50444 with identifier: AR37862 to the API
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AR37862>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'diesel',
 'id': 'be914301-f5ec-5d06-972c-f7e752f50444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR37862',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 269526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_bda49b471655f1cf1503f67362b4d46a.jpg',
                'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_5403335304e3592f15d5ffce71573252.jpg',
                'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_130bc1642f2d6fc3ba31c25c7f129fda.jpg',
                'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_4c243faee5f9661d7fef009b2a946bac.jpg',
                'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_09c173705f9ef2b3eea730a18c32fca1.jpg',
                'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_530ee01a3bcf96f707c7dba5071a70f8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be914301-f5ec-5d06-972c-f7e752f50444/be914301-f5ec-5d06-972c-f7e752f50444_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_bda49b471655f1cf1503f67362b4d46a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be914301-f5ec-5d06-972c-f7e752f50444/be914301-f5ec-5d06-972c-f7e752f50444_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_5403335304e3592f15d5ffce71573252.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be914301-f5ec-5d06-972c-f7e752f50444/be914301-f5ec-5d06-972c-f7e752f50444_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_130bc1642f2d6fc3ba31c25c7f129fda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be914301-f5ec-5d06-972c-f7e752f50444/be914301-f5ec-5d06-972c-f7e752f50444_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_4c243faee5f9661d7fef009b2a946bac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be914301-f5ec-5d06-972c-f7e752f50444/be914301-f5ec-5d06-972c-f7e752f50444_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_09c173705f9ef2b3eea730a18c32fca1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be914301-f5ec-5d06-972c-f7e752f50444/be914301-f5ec-5d06-972c-f7e752f50444_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/31/8f3148b7781be822a89f7467e1331738/pa/AR37862_530ee01a3bcf96f707c7dba5071a70f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37862%27 HTTP/1.1" 200 None
2026-03-28 10:39:54 [auto1.de] INFO: Saving data for AR37862: {'created_time': 1774694394.995399, 'last_price_update_time': 1774694394.995413, 'auction_closing_time': 1774884330.0}
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR37862') HTTP/1.1" 204 0
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_bf7ff5305222a7bd08a316a2f2de58fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_bf7ff5305222a7bd08a316a2f2de58fd.jpg not downloaded yet
2026-03-28 10:39:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_b194561dea1338a4253a508e12fee8bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_b1c8f58716b3d056a17d3432fc540355.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_b1c8f58716b3d056a17d3432fc540355.jpg not downloaded yet
2026-03-28 10:39:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd30710>
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_4efc3e12c54c0a71eca724c58f3a3265.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_4efc3e12c54c0a71eca724c58f3a3265.jpg saved to cache
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfe1d90>
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_ec7b0741cbab02a964a7a1f20a627253.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_ec7b0741cbab02a964a7a1f20a627253.jpg saved to cache
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8908110>
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_53d9e04ec6da93a350f87d01ffdca5af.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_53d9e04ec6da93a350f87d01ffdca5af.jpg saved to cache
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfe1410>
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_687eee5150d628974057470b8a301c16.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_687eee5150d628974057470b8a301c16.jpg saved to cache
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599
2026-03-28 10:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with scrape type 1
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_8530e3aeba399e24aa76cdf0cc08b83c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_8530e3aeba399e24aa76cdf0cc08b83c.jpg already downloaded
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_d0a088deb5829574451bee753e81ee88.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_d0a088deb5829574451bee753e81ee88.jpg already downloaded
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_68c55770a5fe7edb7964bcabb2a8c960.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_68c55770a5fe7edb7964bcabb2a8c960.jpg already downloaded
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_33de05d5d4657094d423ce8ee2e8bf3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_33de05d5d4657094d423ce8ee2e8bf3f.jpg already downloaded
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_20417167b7258b6eaa213663f465f5b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_20417167b7258b6eaa213663f465f5b8.jpg already downloaded
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_52fba3c58680aa09b2e491c666a48ec3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_52fba3c58680aa09b2e491c666a48ec3.jpg already downloaded
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_4f55b8e1bfc0751e0bf6c51ff99095be.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_4f55b8e1bfc0751e0bf6c51ff99095be.jpg already downloaded
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_817a3c73dfa3213f92e1d7c918b9b6eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_817a3c73dfa3213f92e1d7c918b9b6eb.jpg already downloaded
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_29439b099c88a9e70b0a08b186b1ed82.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_29439b099c88a9e70b0a08b186b1ed82.jpg already downloaded
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg86%252Fb1%252F86b1fe3d683696f9d8fa5ef1fbdc26a8%252Fpa%252FFN47599_ac8755557b739b3dab4ece41fc2e2430.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_ac8755557b739b3dab4ece41fc2e2430.jpg already downloaded
2026-03-28 10:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99, identifier: FN47599
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_71f426fe0f95e584a40c48f6f85df3a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_71f426fe0f95e584a40c48f6f85df3a0.jpg not downloaded yet
2026-03-28 10:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599
2026-03-28 10:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599
2026-03-28 10:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92c1cde4-d2ca-50cd-beb9-b19a20d7bc99 with identifier: FN47599 to the API
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FN47599>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:11Z',
 'fuel_type': 'diesel',
 'id': '92c1cde4-d2ca-50cd-beb9-b19a20d7bc99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN47599',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 152055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_8530e3aeba399e24aa76cdf0cc08b83c.jpg',
                'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_d0a088deb5829574451bee753e81ee88.jpg',
                'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_68c55770a5fe7edb7964bcabb2a8c960.jpg',
                'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_33de05d5d4657094d423ce8ee2e8bf3f.jpg',
                'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_20417167b7258b6eaa213663f465f5b8.jpg',
                'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_52fba3c58680aa09b2e491c666a48ec3.jpg',
                'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_4f55b8e1bfc0751e0bf6c51ff99095be.jpg',
                'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_817a3c73dfa3213f92e1d7c918b9b6eb.jpg',
                'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_29439b099c88a9e70b0a08b186b1ed82.jpg',
                'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_ac8755557b739b3dab4ece41fc2e2430.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_8530e3aeba399e24aa76cdf0cc08b83c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_d0a088deb5829574451bee753e81ee88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_68c55770a5fe7edb7964bcabb2a8c960.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_33de05d5d4657094d423ce8ee2e8bf3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_20417167b7258b6eaa213663f465f5b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_52fba3c58680aa09b2e491c666a48ec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_4f55b8e1bfc0751e0bf6c51ff99095be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_817a3c73dfa3213f92e1d7c918b9b6eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_29439b099c88a9e70b0a08b186b1ed82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_92c1cde4-d2ca-50cd-beb9-b19a20d7bc99/92c1cde4-d2ca-50cd-beb9-b19a20d7bc99_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58900,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img86/b1/86b1fe3d683696f9d8fa5ef1fbdc26a8/pa/FN47599_ac8755557b739b3dab4ece41fc2e2430.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-13',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-28 10:39:56 [auto1.de] INFO: Saving data for FN47599: {'created_time': 1774694396.139286, 'last_price_update_time': 1774694396.139298, 'auction_closing_time': 1774885571.0}
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN47599') HTTP/1.1" 204 0
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_71294a80f74930787da4417eb1ce5ad1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_71294a80f74930787da4417eb1ce5ad1.jpg not downloaded yet
2026-03-28 10:39:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:39:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd2ce50>
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_b194561dea1338a4253a508e12fee8bf.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_b194561dea1338a4253a508e12fee8bf.jpg saved to cache
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_53364a024222fa581aff7ac2040bf752.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_39d9bd4423d7659f438239192a7788a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_9cbadb84ff6de8e921852bbd99c7957e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe5ef90>
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_53364a024222fa581aff7ac2040bf752.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_53364a024222fa581aff7ac2040bf752.jpg saved to cache
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_be96839dd240ac9c5450b5d9141f88f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_bf7ff5305222a7bd08a316a2f2de58fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_b1c8f58716b3d056a17d3432fc540355.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad71d0>
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_39d9bd4423d7659f438239192a7788a5.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_39d9bd4423d7659f438239192a7788a5.jpg saved to cache
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:56 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba801990>
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcd%252Fe2%252Fcde246382ea0c5fe9993b272a9b17ecd%252Fpa%252FMF41650_9cbadb84ff6de8e921852bbd99c7957e.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_9cbadb84ff6de8e921852bbd99c7957e.jpg saved to cache
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577
2026-03-28 10:39:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577, skipping ID generation
2026-03-28 10:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with scrape type 1
2026-03-28 10:39:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 sending to next pipeline
2026-03-28 10:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577, identifier: MF41650
2026-03-28 10:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650
2026-03-28 10:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650
2026-03-28 10:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 572fd3f9-1eaf-5c0f-a2ad-faf61d021577 with identifier: MF41650 to the API
2026-03-28 10:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_9cbadb84ff6de8e921852bbd99c7957e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:30:01Z',
 'fuel_type': 'petrol',
 'id': '572fd3f9-1eaf-5c0f-a2ad-faf61d021577',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF41650',
 'listing': 'auction',
 'location': 'DE, Aurich',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 134524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519381,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_39d9bd4423d7659f438239192a7788a5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_039c8901d9e5b3d06859b5dad09e5be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_4594debaaefb392c62f2aea5d90951ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_97b8a253bf9354b83eae8c25490549e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_d662feed873b4e1dc7631e470931a33e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541848,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_53364a024222fa581aff7ac2040bf752.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_87b94c80ce12dcfb99171c86fd0f6c68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_687eee5150d628974057470b8a301c16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_53d9e04ec6da93a350f87d01ffdca5af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572fd3f9-1eaf-5c0f-a2ad-faf61d021577/572fd3f9-1eaf-5c0f-a2ad-faf61d021577_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3041044,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcd/e2/cde246382ea0c5fe9993b272a9b17ecd/pa/MF41650_9cbadb84ff6de8e921852bbd99c7957e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 T5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2016}
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-28 10:39:57 [auto1.de] INFO: Saving data for MF41650: {'created_time': 1774694397.28224, 'last_price_update_time': 1774694397.282251, 'auction_closing_time': 1774884601.0}
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF41650') HTTP/1.1" 204 0
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_71294a80f74930787da4417eb1ce5ad1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a0bc90>
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_be96839dd240ac9c5450b5d9141f88f9.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_be96839dd240ac9c5450b5d9141f88f9.jpg saved to cache
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88c8d50>
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_bf7ff5305222a7bd08a316a2f2de58fd.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_bf7ff5305222a7bd08a316a2f2de58fd.jpg saved to cache
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe8f150>
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_b1c8f58716b3d056a17d3432fc540355.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_b1c8f58716b3d056a17d3432fc540355.jpg saved to cache
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF55649> (referer: https://www.auto1.com/v1/car-details-view/DF55649/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab96d7ed0>
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_71294a80f74930787da4417eb1ce5ad1.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_71294a80f74930787da4417eb1ce5ad1.jpg saved to cache
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_6dcff0ce5e0ad1625a07af7514834161.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_273234773805f4dc14cc763478d7b262.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_3d5826e35eb7c9c3522d005a3e8379f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_71f426fe0f95e584a40c48f6f85df3a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_0d8853aa3343311501e8c287440aea10.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_612c52f7e0d9608f8390a62a1f33f2de.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_cc803b421162224c58c4ece2535ef672.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_311fc812fdcba0b908899ab3a8d1a337.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_ecc72888b010ea1a0c04fbccd52633db.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649
2026-03-28 10:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1436325f-8282-5f93-be02-60a6e76a0da7 with scrape type 1
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_1518383dd494b19e390701033fd69d7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_1518383dd494b19e390701033fd69d7c.jpg not downloaded yet
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_e6845b0dc83ed136ec50c0195fb8f8a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_d54b7f30659ac9281707410d626ff657.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_d54b7f30659ac9281707410d626ff657.jpg not downloaded yet
2026-03-28 10:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_bf4c726910a65ecf8fd14546fbf7c97b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_3cac7e77467b770da42b3de878f6c8fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_3cac7e77467b770da42b3de878f6c8fc.jpg not downloaded yet
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_9cafcbbfc8dad8e25fc2fbdc070b935d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_9cafcbbfc8dad8e25fc2fbdc070b935d.jpg not downloaded yet
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe91fd0>
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_6dcff0ce5e0ad1625a07af7514834161.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_6dcff0ce5e0ad1625a07af7514834161.jpg saved to cache
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ffb50>
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_273234773805f4dc14cc763478d7b262.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_273234773805f4dc14cc763478d7b262.jpg saved to cache
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd0f950>
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_3d5826e35eb7c9c3522d005a3e8379f7.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_3d5826e35eb7c9c3522d005a3e8379f7.jpg saved to cache
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ffcd0>
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_71f426fe0f95e584a40c48f6f85df3a0.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_71f426fe0f95e584a40c48f6f85df3a0.jpg saved to cache
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_328d7a962083e5cffca53e3c0d719126.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_328d7a962083e5cffca53e3c0d719126.jpg not downloaded yet
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_514f8d186690df517634a1c14731e244.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_514f8d186690df517634a1c14731e244.jpg not downloaded yet
2026-03-28 10:39:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe4ecd0>
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_0d8853aa3343311501e8c287440aea10.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_0d8853aa3343311501e8c287440aea10.jpg saved to cache
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfbc790>
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_612c52f7e0d9608f8390a62a1f33f2de.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_612c52f7e0d9608f8390a62a1f33f2de.jpg saved to cache
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdddc10>
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_cc803b421162224c58c4ece2535ef672.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_cc803b421162224c58c4ece2535ef672.jpg saved to cache
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb3690>
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg09%252Fdf%252F09df98bc96bf95e34ebaeca44a88ad55%252Fpa%252FJN77870_311fc812fdcba0b908899ab3a8d1a337.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_311fc812fdcba0b908899ab3a8d1a337.jpg saved to cache
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5
2026-03-28 10:39:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72b17b06-64e3-5e26-8752-0dc02cf8bca5, skipping ID generation
2026-03-28 10:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with scrape type 1
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72b17b06-64e3-5e26-8752-0dc02cf8bca5 sending to next pipeline
2026-03-28 10:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72b17b06-64e3-5e26-8752-0dc02cf8bca5, identifier: JN77870
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd472d0>
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_ecc72888b010ea1a0c04fbccd52633db.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_ecc72888b010ea1a0c04fbccd52633db.jpg saved to cache
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe4f050>
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_e6845b0dc83ed136ec50c0195fb8f8a2.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_e6845b0dc83ed136ec50c0195fb8f8a2.jpg saved to cache
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaad2390>
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_bf4c726910a65ecf8fd14546fbf7c97b.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_bf4c726910a65ecf8fd14546fbf7c97b.jpg saved to cache
2026-03-28 10:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870
2026-03-28 10:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870
2026-03-28 10:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72b17b06-64e3-5e26-8752-0dc02cf8bca5 with identifier: JN77870 to the API
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_311fc812fdcba0b908899ab3a8d1a337.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.9L',
 'engine_horse_power': 330,
 'expiration_date': '2026-03-30T15:28:06Z',
 'fuel_type': 'diesel',
 'id': '72b17b06-64e3-5e26-8752-0dc02cf8bca5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN77870',
 'listing': 'auction',
 'location': 'DE, Aurich',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 75850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_ec7b0741cbab02a964a7a1f20a627253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2638197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_cc803b421162224c58c4ece2535ef672.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745013,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_311fc812fdcba0b908899ab3a8d1a337.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2484598,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_0d8853aa3343311501e8c287440aea10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2725092,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_612c52f7e0d9608f8390a62a1f33f2de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_be96839dd240ac9c5450b5d9141f88f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_bf7ff5305222a7bd08a316a2f2de58fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_b1c8f58716b3d056a17d3432fc540355.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2730552,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_71f426fe0f95e584a40c48f6f85df3a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72b17b06-64e3-5e26-8752-0dc02cf8bca5/72b17b06-64e3-5e26-8752-0dc02cf8bca5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img09/df/09df98bc96bf95e34ebaeca44a88ad55/pa/JN77870_71294a80f74930787da4417eb1ce5ad1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN77870%27 HTTP/1.1" 200 None
2026-03-28 10:39:59 [auto1.de] INFO: Saving data for JN77870: {'created_time': 1774694399.070006, 'last_price_update_time': 1774694399.070018, 'auction_closing_time': 1774884486.0}
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN77870') HTTP/1.1" 204 0
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_b2425aa27078daffde75b8304de7b976.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_b2425aa27078daffde75b8304de7b976.jpg not downloaded yet
2026-03-28 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED71538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_cff7c194e3d3b615090a417bbdf6fb3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_cff7c194e3d3b615090a417bbdf6fb3b.jpg not downloaded yet
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_096e587f41f1e6c1e2123fd1b4092040.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_096e587f41f1e6c1e2123fd1b4092040.jpg not downloaded yet
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_55f0ff3bb7de27990f57f64a98c0039d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_55f0ff3bb7de27990f57f64a98c0039d.jpg not downloaded yet
2026-03-28 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_1d916c8082f16659204eaa0154c27df8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_261197f7eb1000b6684dfe2f9d23af92.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_a5c8c74d03dc9f60eea548719d321183.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_b348428c0ad3194da9a38aec873fced1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_6414939ef591054ef205eb472dbc66d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc4e4d0>
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_1d916c8082f16659204eaa0154c27df8.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_1d916c8082f16659204eaa0154c27df8.jpg saved to cache
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_b2425aa27078daffde75b8304de7b976.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:39:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8ccd0>
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fb7%252F8ab7a561db3639a9e919185a4e26e321%252Fpa%252FRG68419_261197f7eb1000b6684dfe2f9d23af92.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_261197f7eb1000b6684dfe2f9d23af92.jpg saved to cache
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe
2026-03-28 10:39:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4f1776e-456f-5ca3-9373-159f5ed2fbfe, skipping ID generation
2026-03-28 10:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe with scrape type 1
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4f1776e-456f-5ca3-9373-159f5ed2fbfe sending to next pipeline
2026-03-28 10:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4f1776e-456f-5ca3-9373-159f5ed2fbfe, identifier: RG68419
2026-03-28 10:39:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88be1d0>
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_a5c8c74d03dc9f60eea548719d321183.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_a5c8c74d03dc9f60eea548719d321183.jpg saved to cache
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfbdd90>
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F69%252Fa769ea1896a87ef0f50a30933060dd58%252Fpa%252FGJ08958_b348428c0ad3194da9a38aec873fced1.jpg') HTTP/1.1" 204 0
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_b348428c0ad3194da9a38aec873fced1.jpg saved to cache
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f6bdfff-f77d-502c-908b-e8357da2500d
2026-03-28 10:39:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f6bdfff-f77d-502c-908b-e8357da2500d, skipping ID generation
2026-03-28 10:39:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f6bdfff-f77d-502c-908b-e8357da2500d with scrape type 1
2026-03-28 10:39:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f6bdfff-f77d-502c-908b-e8357da2500d sending to next pipeline
2026-03-28 10:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f6bdfff-f77d-502c-908b-e8357da2500d, identifier: GJ08958
2026-03-28 10:39:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ababdcb50>
2026-03-28 10:39:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:39:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_6414939ef591054ef205eb472dbc66d7.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_6414939ef591054ef205eb472dbc66d7.jpg saved to cache
2026-03-28 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419
2026-03-28 10:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419
2026-03-28 10:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4f1776e-456f-5ca3-9373-159f5ed2fbfe with identifier: RG68419 to the API
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_261197f7eb1000b6684dfe2f9d23af92.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:00:44Z',
 'fuel_type': 'petrol',
 'id': 'a4f1776e-456f-5ca3-9373-159f5ed2fbfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG68419',
 'listing': 'auction',
 'location': 'DE, Braunschweig',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 58214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2650787,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_261197f7eb1000b6684dfe2f9d23af92.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_ae176565cddb6a022e36d3a82ea65a38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2580055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_1d916c8082f16659204eaa0154c27df8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2519995,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_b194561dea1338a4253a508e12fee8bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_a899a5d5157507dde99ef6df56e54e99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82869,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_ecc72888b010ea1a0c04fbccd52633db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_2e2143c3b8636575cce9d4f846074031.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_b71f4533af8a66d7db1ef7d7c8b23373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_273234773805f4dc14cc763478d7b262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4f1776e-456f-5ca3-9373-159f5ed2fbfe/a4f1776e-456f-5ca3-9373-159f5ed2fbfe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/b7/8ab7a561db3639a9e919185a4e26e321/pa/RG68419_80791a5d319aedec57316d3e9182bc6d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2018}
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-28 10:40:00 [auto1.de] INFO: Saving data for RG68419: {'created_time': 1774694400.512675, 'last_price_update_time': 1774694400.512684, 'auction_closing_time': 1774882844.0}
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG68419') HTTP/1.1" 204 0
2026-03-28 10:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958
2026-03-28 10:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958
2026-03-28 10:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f6bdfff-f77d-502c-908b-e8357da2500d with identifier: GJ08958 to the API
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_b348428c0ad3194da9a38aec873fced1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 250,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '3.0L',
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:57:21Z',
 'fuel_type': 'diesel',
 'id': '2f6bdfff-f77d-502c-908b-e8357da2500d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ08958',
 'listing': 'auction',
 'location': 'DE, Heilbronn',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 284990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839196,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_b348428c0ad3194da9a38aec873fced1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_5f8707b4db1137fc44a62fa874cf5fe6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2797477,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_a5c8c74d03dc9f60eea548719d321183.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_e6845b0dc83ed136ec50c0195fb8f8a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_4d3ba953e28616b3d6feb2dfdabeb65c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_bf4c726910a65ecf8fd14546fbf7c97b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_2a4f1c9bf153439c80bb4aa1a3d7deab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_6dcff0ce5e0ad1625a07af7514834161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_3d5826e35eb7c9c3522d005a3e8379f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f6bdfff-f77d-502c-908b-e8357da2500d/2f6bdfff-f77d-502c-908b-e8357da2500d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/69/a769ea1896a87ef0f50a30933060dd58/pa/GJ08958_59adf173e1af7d918cd45d9d7a6258be.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X5 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-28 10:40:00 [auto1.de] INFO: Saving data for GJ08958: {'created_time': 1774694400.904261, 'last_price_update_time': 1774694400.904271, 'auction_closing_time': 1774886241.0}
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ08958') HTTP/1.1" 204 0
2026-03-28 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_328d7a962083e5cffca53e3c0d719126.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_514f8d186690df517634a1c14731e244.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_55f0ff3bb7de27990f57f64a98c0039d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a07090>
2026-03-28 10:40:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_b2425aa27078daffde75b8304de7b976.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_b2425aa27078daffde75b8304de7b976.jpg saved to cache
2026-03-28 10:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_9cafcbbfc8dad8e25fc2fbdc070b935d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_3cac7e77467b770da42b3de878f6c8fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_d54b7f30659ac9281707410d626ff657.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_1518383dd494b19e390701033fd69d7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_28a949f93312449519b8a10fee163e36.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdf7d0>
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_328d7a962083e5cffca53e3c0d719126.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_328d7a962083e5cffca53e3c0d719126.jpg saved to cache
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd5a550>
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_514f8d186690df517634a1c14731e244.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_514f8d186690df517634a1c14731e244.jpg saved to cache
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba79b790>
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_55f0ff3bb7de27990f57f64a98c0039d.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_55f0ff3bb7de27990f57f64a98c0039d.jpg saved to cache
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:01 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 9641 | hits on page: 40
2026-03-28 10:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf94ad0>
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_9cafcbbfc8dad8e25fc2fbdc070b935d.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_9cafcbbfc8dad8e25fc2fbdc070b935d.jpg saved to cache
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd56850>
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_3cac7e77467b770da42b3de878f6c8fc.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_3cac7e77467b770da42b3de878f6c8fc.jpg saved to cache
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88a3910>
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_d54b7f30659ac9281707410d626ff657.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_d54b7f30659ac9281707410d626ff657.jpg saved to cache
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a72a10>
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_1518383dd494b19e390701033fd69d7c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_1518383dd494b19e390701033fd69d7c.jpg saved to cache
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a70ed0>
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_28a949f93312449519b8a10fee163e36.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_28a949f93312449519b8a10fee163e36.jpg saved to cache
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for RC95289: 0
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for GE96927: 0
2026-03-28 10:40:01 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL36309%27 HTTP/1.1" 200 None
2026-03-28 10:40:01 [auto1.de] INFO: Scrape type for XL36309: 2
2026-03-28 10:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309
2026-03-28 10:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7d84747-dab8-5f4c-a11f-319f68f7ed1e with scrape type 2
2026-03-28 10:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7d84747-dab8-5f4c-a11f-319f68f7ed1e with scrape type 2
2026-03-28 10:40:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7d84747-dab8-5f4c-a11f-319f68f7ed1e, identifier: XL36309
2026-03-28 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_2626eca6bbc3bca3147a3e3d53d4ea8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_096e587f41f1e6c1e2123fd1b4092040.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_cff7c194e3d3b615090a417bbdf6fb3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309
2026-03-28 10:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309
2026-03-28 10:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7d84747-dab8-5f4c-a11f-319f68f7ed1e with identifier: XL36309 to the API
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:13:16Z',
 'fuel_type': 'petrol',
 'id': 'e7d84747-dab8-5f4c-a11f-319f68f7ed1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL36309',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 99065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-02',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Attract',
 'transmission': 'manual',
 'trim': 'Attract',
 'year': 2011}
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL36309%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Saving data for XL36309: {'auction_closing_time': 1774883596.0, 'created_time': 1774035533.588183, 'last_price_update_time': 1774694402.25184}
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL36309') HTTP/1.1" 204 0
2026-03-28 10:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM75567%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Scrape type for FM75567: 2
2026-03-28 10:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567
2026-03-28 10:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0646a2db-3728-530c-a382-4c6cd92c5746 with scrape type 2
2026-03-28 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0646a2db-3728-530c-a382-4c6cd92c5746 with scrape type 2
2026-03-28 10:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0646a2db-3728-530c-a382-4c6cd92c5746, identifier: FM75567
2026-03-28 10:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567
2026-03-28 10:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567
2026-03-28 10:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0646a2db-3728-530c-a382-4c6cd92c5746 with identifier: FM75567 to the API
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:52Z',
 'fuel_type': 'diesel',
 'id': '0646a2db-3728-530c-a382-4c6cd92c5746',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM75567',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 153696,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-22',
 'seller_name': None,
 'title': 'Audi A3 2.0 TDI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2013}
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM75567%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Saving data for FM75567: {'auction_closing_time': 1774883032.0, 'created_time': 1774033948.411529, 'last_price_update_time': 1774694402.733347}
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM75567') HTTP/1.1" 204 0
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU93300%27 HTTP/1.1" 200 None
2026-03-28 10:40:02 [auto1.de] INFO: Scrape type for TU93300: 1
2026-03-28 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_8148e794d1a0d3043150cf278a49f38c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_52fb7fab7f14a38d758c3fb8c4c59196.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_f46d948261c1b026f80a67d1e2478ca8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdded90>
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_2626eca6bbc3bca3147a3e3d53d4ea8a.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_2626eca6bbc3bca3147a3e3d53d4ea8a.jpg saved to cache
2026-03-28 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe422d0>
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_096e587f41f1e6c1e2123fd1b4092040.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_096e587f41f1e6c1e2123fd1b4092040.jpg saved to cache
2026-03-28 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5f610>
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3f%252F48%252F3f48a8d594bcdb63e5f9af7c4bd70d88%252Fpa%252FDF55649_cff7c194e3d3b615090a417bbdf6fb3b.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_cff7c194e3d3b615090a417bbdf6fb3b.jpg saved to cache
2026-03-28 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1436325f-8282-5f93-be02-60a6e76a0da7
2026-03-28 10:40:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1436325f-8282-5f93-be02-60a6e76a0da7, skipping ID generation
2026-03-28 10:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1436325f-8282-5f93-be02-60a6e76a0da7 with scrape type 1
2026-03-28 10:40:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1436325f-8282-5f93-be02-60a6e76a0da7 sending to next pipeline
2026-03-28 10:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1436325f-8282-5f93-be02-60a6e76a0da7, identifier: DF55649
2026-03-28 10:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:02 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-28 10:40:03 [auto1.de] INFO: Scrape type for SH00876: 1
2026-03-28 10:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649
2026-03-28 10:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649
2026-03-28 10:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1436325f-8282-5f93-be02-60a6e76a0da7 with identifier: DF55649 to the API
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_cff7c194e3d3b615090a417bbdf6fb3b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:47:28Z',
 'fuel_type': 'petrol',
 'id': '1436325f-8282-5f93-be02-60a6e76a0da7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF55649',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 67060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2742783,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_1518383dd494b19e390701033fd69d7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2505762,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_d54b7f30659ac9281707410d626ff657.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2561269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_3cac7e77467b770da42b3de878f6c8fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2370959,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_9cafcbbfc8dad8e25fc2fbdc070b935d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_328d7a962083e5cffca53e3c0d719126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_514f8d186690df517634a1c14731e244.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_b2425aa27078daffde75b8304de7b976.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_cff7c194e3d3b615090a417bbdf6fb3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_096e587f41f1e6c1e2123fd1b4092040.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1436325f-8282-5f93-be02-60a6e76a0da7/1436325f-8282-5f93-be02-60a6e76a0da7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3f/48/3f48a8d594bcdb63e5f9af7c4bd70d88/pa/DF55649_55f0ff3bb7de27990f57f64a98c0039d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55649%27 HTTP/1.1" 200 None
2026-03-28 10:40:03 [auto1.de] INFO: Saving data for DF55649: {'created_time': 1774694403.378595, 'last_price_update_time': 1774694403.378606, 'auction_closing_time': 1774885648.0}
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF55649') HTTP/1.1" 204 0
2026-03-28 10:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_d08cfa735c5fcf842c339bc980c7ef4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:03 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-28 10:40:03 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44580%27 HTTP/1.1" 200 None
2026-03-28 10:40:03 [auto1.de] INFO: Scrape type for AG44580: 2
2026-03-28 10:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580
2026-03-28 10:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d96409da-afd3-5edc-8ff4-9cc587bc71f0 with scrape type 2
2026-03-28 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d96409da-afd3-5edc-8ff4-9cc587bc71f0 with scrape type 2
2026-03-28 10:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d96409da-afd3-5edc-8ff4-9cc587bc71f0, identifier: AG44580
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88a2810>
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_8148e794d1a0d3043150cf278a49f38c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_8148e794d1a0d3043150cf278a49f38c.jpg saved to cache
2026-03-28 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88fd410>
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_52fb7fab7f14a38d758c3fb8c4c59196.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_52fb7fab7f14a38d758c3fb8c4c59196.jpg saved to cache
2026-03-28 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88eab90>
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_f46d948261c1b026f80a67d1e2478ca8.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_f46d948261c1b026f80a67d1e2478ca8.jpg saved to cache
2026-03-28 10:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580
2026-03-28 10:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580
2026-03-28 10:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d96409da-afd3-5edc-8ff4-9cc587bc71f0 with identifier: AG44580 to the API
2026-03-28 10:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:36:28Z',
 'fuel_type': 'diesel',
 'id': 'd96409da-afd3-5edc-8ff4-9cc587bc71f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG44580',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 177025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-11',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44580%27 HTTP/1.1" 200 None
2026-03-28 10:40:04 [auto1.de] INFO: Saving data for AG44580: {'auction_closing_time': 1774884988.0, 'created_time': 1774034982.916842, 'last_price_update_time': 1774694404.977498}
2026-03-28 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG44580') HTTP/1.1" 204 0
2026-03-28 10:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_7602d5e31ef6d7d98ace40bde0241abf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:05 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-28 10:40:05 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-28 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP91666%27 HTTP/1.1" 200 None
2026-03-28 10:40:05 [auto1.de] INFO: Scrape type for RP91666: 2
2026-03-28 10:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666
2026-03-28 10:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with scrape type 2
2026-03-28 10:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with scrape type 2
2026-03-28 10:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88, identifier: RP91666
2026-03-28 10:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_2c03cacdc9107333dd474a477cb6d38f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666
2026-03-28 10:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666
2026-03-28 10:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f7475fb-78f6-5fde-bfdb-5f6d62d44a88 with identifier: RP91666 to the API
2026-03-28 10:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:31:59Z',
 'fuel_type': 'petrol',
 'id': '6f7475fb-78f6-5fde-bfdb-5f6d62d44a88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP91666',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 83960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 10:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP91666%27 HTTP/1.1" 200 None
2026-03-28 10:40:06 [auto1.de] INFO: Saving data for RP91666: {'auction_closing_time': 1774884719.0, 'created_time': 1773427794.434334, 'last_price_update_time': 1774694406.113035}
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP91666') HTTP/1.1" 204 0
2026-03-28 10:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:06 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS46144%27 HTTP/1.1" 200 None
2026-03-28 10:40:06 [auto1.de] INFO: Scrape type for YS46144: 2
2026-03-28 10:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144
2026-03-28 10:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6c44470-b59c-53a5-89da-d0a9941966d1 with scrape type 2
2026-03-28 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6c44470-b59c-53a5-89da-d0a9941966d1 with scrape type 2
2026-03-28 10:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6c44470-b59c-53a5-89da-d0a9941966d1, identifier: YS46144
2026-03-28 10:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda40d0>
2026-03-28 10:40:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_d08cfa735c5fcf842c339bc980c7ef4b.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_d08cfa735c5fcf842c339bc980c7ef4b.jpg saved to cache
2026-03-28 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144
2026-03-28 10:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144
2026-03-28 10:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6c44470-b59c-53a5-89da-d0a9941966d1 with identifier: YS46144 to the API
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-30T15:59:34Z',
 'fuel_type': 'petrol',
 'id': 'f6c44470-b59c-53a5-89da-d0a9941966d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS46144',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 212721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-15',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 500 T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2008}
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS46144%27 HTTP/1.1" 200 None
2026-03-28 10:40:06 [auto1.de] INFO: Saving data for YS46144: {'auction_closing_time': 1774886374.0, 'created_time': 1773429048.268717, 'last_price_update_time': 1774694406.606153}
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS46144') HTTP/1.1" 204 0
2026-03-28 10:40:06 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE92832%27 HTTP/1.1" 200 None
2026-03-28 10:40:06 [auto1.de] INFO: Scrape type for BE92832: 2
2026-03-28 10:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832
2026-03-28 10:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c919492-41be-565a-bc14-3c79d4bd00bc with scrape type 2
2026-03-28 10:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c919492-41be-565a-bc14-3c79d4bd00bc with scrape type 2
2026-03-28 10:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c919492-41be-565a-bc14-3c79d4bd00bc, identifier: BE92832
2026-03-28 10:40:06 [scrapy.extensions.logstats] INFO: Crawled 189 pages (at 62 pages/min), scraped 133 items (at 41 items/min)
2026-03-28 10:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 10:40:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832
2026-03-28 10:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c919492-41be-565a-bc14-3c79d4bd00bc with identifier: BE92832 to the API
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:15Z',
 'fuel_type': 'petrol',
 'id': '5c919492-41be-565a-bc14-3c79d4bd00bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE92832',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid',
 'odometer': 137612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Skoda Rapid 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE92832%27 HTTP/1.1" 200 None
2026-03-28 10:40:07 [auto1.de] INFO: Saving data for BE92832: {'auction_closing_time': 1774884435.0, 'created_time': 1774350454.977619, 'last_price_update_time': 1774694407.276992}
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE92832') HTTP/1.1" 204 0
2026-03-28 10:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8f610>
2026-03-28 10:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_7602d5e31ef6d7d98ace40bde0241abf.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_7602d5e31ef6d7d98ace40bde0241abf.jpg saved to cache
2026-03-28 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:40:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf62350>
2026-03-28 10:40:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_2c03cacdc9107333dd474a477cb6d38f.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_2c03cacdc9107333dd474a477cb6d38f.jpg saved to cache
2026-03-28 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:40:07 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 9641 | hits on page: 40
2026-03-28 10:40:07 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-28 10:40:07 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63274%27 HTTP/1.1" 200 None
2026-03-28 10:40:07 [auto1.de] INFO: Scrape type for TN63274: 1
2026-03-28 10:40:07 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31995%27 HTTP/1.1" 200 None
2026-03-28 10:40:07 [auto1.de] INFO: Scrape type for BA31995: 2
2026-03-28 10:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995
2026-03-28 10:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with scrape type 2
2026-03-28 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with scrape type 2
2026-03-28 10:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10b04593-3a41-523b-9bb5-29a46f0ed0c7, identifier: BA31995
2026-03-28 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_f5bab0a413abd29172fd265d29a10608.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_65e3d7cb392d424790b7f9b335725632.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:07 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ75751%27 HTTP/1.1" 200 None
2026-03-28 10:40:07 [auto1.de] INFO: Scrape type for BJ75751: 2
2026-03-28 10:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751
2026-03-28 10:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with scrape type 2
2026-03-28 10:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with scrape type 2
2026-03-28 10:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b41d75b5-76bc-56bc-bfaa-10b986b21fe6, identifier: BJ75751
2026-03-28 10:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995
2026-03-28 10:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995
2026-03-28 10:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10b04593-3a41-523b-9bb5-29a46f0ed0c7 with identifier: BA31995 to the API
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:48:51Z',
 'fuel_type': 'diesel',
 'id': '10b04593-3a41-523b-9bb5-29a46f0ed0c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA31995',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 119867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31995%27 HTTP/1.1" 200 None
2026-03-28 10:40:07 [auto1.de] INFO: Saving data for BA31995: {'auction_closing_time': 1774885731.0, 'created_time': 1774033863.169293, 'last_price_update_time': 1774694407.998206}
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA31995') HTTP/1.1" 204 0
2026-03-28 10:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF72133> (referer: https://www.auto1.com/v1/car-details-view/DF72133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751
2026-03-28 10:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751
2026-03-28 10:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b41d75b5-76bc-56bc-bfaa-10b986b21fe6 with identifier: BJ75751 to the API
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:00:24Z',
 'fuel_type': 'petrol',
 'id': 'b41d75b5-76bc-56bc-bfaa-10b986b21fe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ75751',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 94885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-28',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ75751%27 HTTP/1.1" 200 None
2026-03-28 10:40:08 [auto1.de] INFO: Saving data for BJ75751: {'auction_closing_time': 1774882824.0, 'created_time': 1774035456.590379, 'last_price_update_time': 1774694408.324418}
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ75751') HTTP/1.1" 204 0
2026-03-28 10:40:08 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-28 10:40:08 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-28 10:40:08 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-28 10:40:08 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF87793%27 HTTP/1.1" 200 None
2026-03-28 10:40:08 [auto1.de] INFO: Scrape type for PF87793: 2
2026-03-28 10:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793
2026-03-28 10:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e22417b4-4de5-5e59-bd1d-314801102de4 with scrape type 2
2026-03-28 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e22417b4-4de5-5e59-bd1d-314801102de4 with scrape type 2
2026-03-28 10:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e22417b4-4de5-5e59-bd1d-314801102de4, identifier: PF87793
2026-03-28 10:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:08 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80456%27 HTTP/1.1" 200 None
2026-03-28 10:40:08 [auto1.de] INFO: Scrape type for ZT80456: 2
2026-03-28 10:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456
2026-03-28 10:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 650d417b-7a87-5852-b228-2837088e2ae0 with scrape type 2
2026-03-28 10:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 650d417b-7a87-5852-b228-2837088e2ae0 with scrape type 2
2026-03-28 10:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 650d417b-7a87-5852-b228-2837088e2ae0, identifier: ZT80456
2026-03-28 10:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793
2026-03-28 10:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793
2026-03-28 10:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e22417b4-4de5-5e59-bd1d-314801102de4 with identifier: PF87793 to the API
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'petrol',
 'id': 'e22417b4-4de5-5e59-bd1d-314801102de4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF87793',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 56599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2018}
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF87793%27 HTTP/1.1" 200 None
2026-03-28 10:40:08 [auto1.de] INFO: Saving data for PF87793: {'auction_closing_time': 1774883806.0, 'created_time': 1773382809.711778, 'last_price_update_time': 1774694408.927065}
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF87793') HTTP/1.1" 204 0
2026-03-28 10:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456
2026-03-28 10:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456
2026-03-28 10:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 650d417b-7a87-5852-b228-2837088e2ae0 with identifier: ZT80456 to the API
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:40:37Z',
 'fuel_type': 'petrol',
 'id': '650d417b-7a87-5852-b228-2837088e2ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT80456',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 186453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-28',
 'seller_name': None,
 'title': 'Skoda Roomster 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80456%27 HTTP/1.1" 200 None
2026-03-28 10:40:09 [auto1.de] INFO: Saving data for ZT80456: {'auction_closing_time': 1774885237.0, 'created_time': 1773382387.080665, 'last_price_update_time': 1774694409.389049}
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT80456') HTTP/1.1" 204 0
2026-03-28 10:40:09 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-28 10:40:09 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR24690%27 HTTP/1.1" 200 None
2026-03-28 10:40:09 [auto1.de] INFO: Scrape type for RR24690: 2
2026-03-28 10:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690
2026-03-28 10:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03fc03a0-6612-5e95-9f7b-af39c676baea with scrape type 2
2026-03-28 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03fc03a0-6612-5e95-9f7b-af39c676baea with scrape type 2
2026-03-28 10:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03fc03a0-6612-5e95-9f7b-af39c676baea, identifier: RR24690
2026-03-28 10:40:09 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67413%27 HTTP/1.1" 200 None
2026-03-28 10:40:09 [auto1.de] INFO: Scrape type for VY67413: 1
2026-03-28 10:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690
2026-03-28 10:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690
2026-03-28 10:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03fc03a0-6612-5e95-9f7b-af39c676baea with identifier: RR24690 to the API
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'petrol',
 'id': '03fc03a0-6612-5e95-9f7b-af39c676baea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR24690',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 56992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-05',
 'seller_name': None,
 'title': 'Opel Meriva 1.8 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2004}
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR24690%27 HTTP/1.1" 200 None
2026-03-28 10:40:09 [auto1.de] INFO: Saving data for RR24690: {'auction_closing_time': 1774882852.0, 'created_time': 1774034185.748281, 'last_price_update_time': 1774694409.850379}
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR24690') HTTP/1.1" 204 0
2026-03-28 10:40:09 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-28 10:40:09 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-28 10:40:09 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD36777%27 HTTP/1.1" 200 None
2026-03-28 10:40:09 [auto1.de] INFO: Scrape type for XD36777: 2
2026-03-28 10:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777
2026-03-28 10:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b101f291-1c0a-5e60-be91-380369a5330b with scrape type 2
2026-03-28 10:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b101f291-1c0a-5e60-be91-380369a5330b with scrape type 2
2026-03-28 10:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b101f291-1c0a-5e60-be91-380369a5330b, identifier: XD36777
2026-03-28 10:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe15950>
2026-03-28 10:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_f5bab0a413abd29172fd265d29a10608.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_f5bab0a413abd29172fd265d29a10608.jpg saved to cache
2026-03-28 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf4e810>
2026-03-28 10:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_65e3d7cb392d424790b7f9b335725632.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_65e3d7cb392d424790b7f9b335725632.jpg saved to cache
2026-03-28 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133
2026-03-28 10:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with scrape type 1
2026-03-28 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_a753aa5c5178d3cf3a575714a320bec9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_a753aa5c5178d3cf3a575714a320bec9.jpg not downloaded yet
2026-03-28 10:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_94b611a4b611180877e5cf37da6fd6ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:10 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69209%27 HTTP/1.1" 200 None
2026-03-28 10:40:10 [auto1.de] INFO: Scrape type for HB69209: 2
2026-03-28 10:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209
2026-03-28 10:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce78ea01-6141-555d-bbf1-a826460b8be7 with scrape type 2
2026-03-28 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce78ea01-6141-555d-bbf1-a826460b8be7 with scrape type 2
2026-03-28 10:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce78ea01-6141-555d-bbf1-a826460b8be7, identifier: HB69209
2026-03-28 10:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777
2026-03-28 10:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777
2026-03-28 10:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b101f291-1c0a-5e60-be91-380369a5330b with identifier: XD36777 to the API
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:33:41Z',
 'fuel_type': 'diesel',
 'id': 'b101f291-1c0a-5e60-be91-380369a5330b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD36777',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 169131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-07',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Innovation ecoFlex',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex',
 'year': 2015}
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD36777%27 HTTP/1.1" 200 None
2026-03-28 10:40:10 [auto1.de] INFO: Saving data for XD36777: {'auction_closing_time': 1774884821.0, 'created_time': 1774033316.388897, 'last_price_update_time': 1774694410.521421}
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD36777') HTTP/1.1" 204 0
2026-03-28 10:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209
2026-03-28 10:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209
2026-03-28 10:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce78ea01-6141-555d-bbf1-a826460b8be7 with identifier: HB69209 to the API
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:48:46Z',
 'fuel_type': 'petrol',
 'id': 'ce78ea01-6141-555d-bbf1-a826460b8be7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB69209',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 127641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI beats',
 'transmission': 'manual',
 'trim': 'beats',
 'year': 2018}
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69209%27 HTTP/1.1" 200 None
2026-03-28 10:40:10 [auto1.de] INFO: Saving data for HB69209: {'auction_closing_time': 1774885726.0, 'created_time': 1774033894.228237, 'last_price_update_time': 1774694410.880212}
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB69209') HTTP/1.1" 204 0
2026-03-28 10:40:10 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC48603%27 HTTP/1.1" 200 None
2026-03-28 10:40:10 [auto1.de] INFO: Scrape type for PC48603: 2
2026-03-28 10:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603
2026-03-28 10:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac61c536-0bdb-5c8f-887c-22e80ff00e6d with scrape type 2
2026-03-28 10:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac61c536-0bdb-5c8f-887c-22e80ff00e6d with scrape type 2
2026-03-28 10:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac61c536-0bdb-5c8f-887c-22e80ff00e6d, identifier: PC48603
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_b1ecfdb166c1b7c5163bacdd721a6cda.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_b1ecfdb166c1b7c5163bacdd721a6cda.jpg not downloaded yet
2026-03-28 10:40:11 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF17035%27 HTTP/1.1" 200 None
2026-03-28 10:40:11 [auto1.de] INFO: Scrape type for GF17035: 2
2026-03-28 10:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035
2026-03-28 10:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with scrape type 2
2026-03-28 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with scrape type 2
2026-03-28 10:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0, identifier: GF17035
2026-03-28 10:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603
2026-03-28 10:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603
2026-03-28 10:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac61c536-0bdb-5c8f-887c-22e80ff00e6d with identifier: PC48603 to the API
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:54Z',
 'fuel_type': 'diesel',
 'id': 'ac61c536-0bdb-5c8f-887c-22e80ff00e6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC48603',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 149435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC',
 'transmission': 'automatic',
 'trim': 'lang 4Matic BlueTEC',
 'year': 2018}
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC48603%27 HTTP/1.1" 200 None
2026-03-28 10:40:11 [auto1.de] INFO: Saving data for PC48603: {'auction_closing_time': 1774883334.0, 'created_time': 1773400760.502129, 'last_price_update_time': 1774694411.472825}
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC48603') HTTP/1.1" 204 0
2026-03-28 10:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035
2026-03-28 10:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035
2026-03-28 10:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0 with identifier: GF17035 to the API
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:48Z',
 'fuel_type': 'petrol',
 'id': '23fa9e74-f6d3-5412-8c4a-0c67aeb4eff0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF17035',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 123319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-24',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2010}
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF17035%27 HTTP/1.1" 200 None
2026-03-28 10:40:11 [auto1.de] INFO: Saving data for GF17035: {'auction_closing_time': 1774885908.0, 'created_time': 1774003270.953743, 'last_price_update_time': 1774694411.812735}
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF17035') HTTP/1.1" 204 0
2026-03-28 10:40:11 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-28 10:40:11 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17699%27 HTTP/1.1" 200 None
2026-03-28 10:40:11 [auto1.de] INFO: Scrape type for GJ17699: 2
2026-03-28 10:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699
2026-03-28 10:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e129244-9817-5315-9826-0565b2e0ceec with scrape type 2
2026-03-28 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e129244-9817-5315-9826-0565b2e0ceec with scrape type 2
2026-03-28 10:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e129244-9817-5315-9826-0565b2e0ceec, identifier: GJ17699
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_3f5bed5311914ae036d9eaa7c59027b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_3f5bed5311914ae036d9eaa7c59027b1.jpg not downloaded yet
2026-03-28 10:40:11 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-28 10:40:11 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV63958%27 HTTP/1.1" 200 None
2026-03-28 10:40:11 [auto1.de] INFO: Scrape type for ZV63958: 1
2026-03-28 10:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699
2026-03-28 10:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699
2026-03-28 10:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e129244-9817-5315-9826-0565b2e0ceec with identifier: GJ17699 to the API
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:29:22Z',
 'fuel_type': 'petrol',
 'id': '0e129244-9817-5315-9826-0565b2e0ceec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ17699',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 160379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-06',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2011}
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17699%27 HTTP/1.1" 200 None
2026-03-28 10:40:12 [auto1.de] INFO: Saving data for GJ17699: {'auction_closing_time': 1774884562.0, 'created_time': 1774001906.450448, 'last_price_update_time': 1774694412.319654}
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ17699') HTTP/1.1" 204 0
2026-03-28 10:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8890750>
2026-03-28 10:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_94b611a4b611180877e5cf37da6fd6ec.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_94b611a4b611180877e5cf37da6fd6ec.jpg saved to cache
2026-03-28 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:40:12 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-28 10:40:12 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47476%27 HTTP/1.1" 200 None
2026-03-28 10:40:12 [auto1.de] INFO: Scrape type for HF47476: 2
2026-03-28 10:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476
2026-03-28 10:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with scrape type 2
2026-03-28 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with scrape type 2
2026-03-28 10:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e, identifier: HF47476
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_a57fafdb2e5f6e3d3c43f6833aa3709c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_a57fafdb2e5f6e3d3c43f6833aa3709c.jpg not downloaded yet
2026-03-28 10:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_a753aa5c5178d3cf3a575714a320bec9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:12 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG24913%27 HTTP/1.1" 200 None
2026-03-28 10:40:12 [auto1.de] INFO: Scrape type for VG24913: 2
2026-03-28 10:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913
2026-03-28 10:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5428b46a-2f48-52d9-a2ad-7345de79f9fa with scrape type 2
2026-03-28 10:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5428b46a-2f48-52d9-a2ad-7345de79f9fa with scrape type 2
2026-03-28 10:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5428b46a-2f48-52d9-a2ad-7345de79f9fa, identifier: VG24913
2026-03-28 10:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476
2026-03-28 10:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476
2026-03-28 10:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26f18a9a-9790-5f6a-bd69-3ef53bf8661e with identifier: HF47476 to the API
2026-03-28 10:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:34:45Z',
 'fuel_type': 'petrol',
 'id': '26f18a9a-9790-5f6a-bd69-3ef53bf8661e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF47476',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 44511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-20',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47476%27 HTTP/1.1" 200 None
2026-03-28 10:40:13 [auto1.de] INFO: Saving data for HF47476: {'auction_closing_time': 1774884885.0, 'created_time': 1774031756.380528, 'last_price_update_time': 1774694413.120015}
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF47476') HTTP/1.1" 204 0
2026-03-28 10:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913
2026-03-28 10:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913
2026-03-28 10:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5428b46a-2f48-52d9-a2ad-7345de79f9fa with identifier: VG24913 to the API
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:51:58Z',
 'fuel_type': 'petrol',
 'id': '5428b46a-2f48-52d9-a2ad-7345de79f9fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG24913',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 156286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-28',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG24913%27 HTTP/1.1" 200 None
2026-03-28 10:40:13 [auto1.de] INFO: Saving data for VG24913: {'auction_closing_time': 1774885918.0, 'created_time': 1774349945.030406, 'last_price_update_time': 1774694413.520099}
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG24913') HTTP/1.1" 204 0
2026-03-28 10:40:13 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-28 10:40:13 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-28 10:40:13 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48276%27 HTTP/1.1" 200 None
2026-03-28 10:40:13 [auto1.de] INFO: Scrape type for DC48276: 2
2026-03-28 10:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276
2026-03-28 10:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81662b1e-9d4b-5d62-8598-92415cfbd56d with scrape type 2
2026-03-28 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81662b1e-9d4b-5d62-8598-92415cfbd56d with scrape type 2
2026-03-28 10:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81662b1e-9d4b-5d62-8598-92415cfbd56d, identifier: DC48276
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_7846bc0b76c2204a655de1181bff7d32.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_7846bc0b76c2204a655de1181bff7d32.jpg not downloaded yet
2026-03-28 10:40:13 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE04045%27 HTTP/1.1" 200 None
2026-03-28 10:40:13 [auto1.de] INFO: Scrape type for XE04045: 2
2026-03-28 10:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045
2026-03-28 10:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de937e9-94f5-5079-903c-375c532e29a7 with scrape type 2
2026-03-28 10:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1de937e9-94f5-5079-903c-375c532e29a7 with scrape type 2
2026-03-28 10:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1de937e9-94f5-5079-903c-375c532e29a7, identifier: XE04045
2026-03-28 10:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 10:40:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 10:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 10:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276
2026-03-28 10:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81662b1e-9d4b-5d62-8598-92415cfbd56d with identifier: DC48276 to the API
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:04:25Z',
 'fuel_type': 'petrol',
 'id': '81662b1e-9d4b-5d62-8598-92415cfbd56d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC48276',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 145832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-21',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2014}
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48276%27 HTTP/1.1" 200 None
2026-03-28 10:40:14 [auto1.de] INFO: Saving data for DC48276: {'auction_closing_time': 1774883065.0, 'created_time': 1774034501.398481, 'last_price_update_time': 1774694414.299998}
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC48276') HTTP/1.1" 204 0
2026-03-28 10:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045
2026-03-28 10:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045
2026-03-28 10:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1de937e9-94f5-5079-903c-375c532e29a7 with identifier: XE04045 to the API
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:46Z',
 'fuel_type': 'diesel',
 'id': '1de937e9-94f5-5079-903c-375c532e29a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE04045',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 52865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-22',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE04045%27 HTTP/1.1" 200 None
2026-03-28 10:40:14 [auto1.de] INFO: Saving data for XE04045: {'auction_closing_time': 1774883386.0, 'created_time': 1774035194.037889, 'last_price_update_time': 1774694414.673225}
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE04045') HTTP/1.1" 204 0
2026-03-28 10:40:14 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-28 10:40:14 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS20438%27 HTTP/1.1" 200 None
2026-03-28 10:40:14 [auto1.de] INFO: Scrape type for DS20438: 1
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_c2829d042278782f1e3e100b7f81e638.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_c2829d042278782f1e3e100b7f81e638.jpg not downloaded yet
2026-03-28 10:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba81d310>
2026-03-28 10:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_a753aa5c5178d3cf3a575714a320bec9.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_a753aa5c5178d3cf3a575714a320bec9.jpg saved to cache
2026-03-28 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462
2026-03-28 10:40:14 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV81203%27 HTTP/1.1" 200 None
2026-03-28 10:40:14 [auto1.de] INFO: Scrape type for UV81203: 2
2026-03-28 10:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203
2026-03-28 10:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05342b4-f6e1-540a-8edb-c35bd6f65172 with scrape type 2
2026-03-28 10:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05342b4-f6e1-540a-8edb-c35bd6f65172 with scrape type 2
2026-03-28 10:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d05342b4-f6e1-540a-8edb-c35bd6f65172, identifier: UV81203
2026-03-28 10:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203
2026-03-28 10:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203
2026-03-28 10:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d05342b4-f6e1-540a-8edb-c35bd6f65172 with identifier: UV81203 to the API
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:30:05Z',
 'fuel_type': 'petrol',
 'id': 'd05342b4-f6e1-540a-8edb-c35bd6f65172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV81203',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 45685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seller_name': None,
 'title': 'Fiat 500X 1.0 Turbo Google',
 'transmission': 'manual',
 'trim': 'Google',
 'year': 2021}
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV81203%27 HTTP/1.1" 200 None
2026-03-28 10:40:15 [auto1.de] INFO: Saving data for UV81203: {'auction_closing_time': 1774884605.0, 'created_time': 1774035358.337396, 'last_price_update_time': 1774694415.276696}
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV81203') HTTP/1.1" 204 0
2026-03-28 10:40:15 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC34542%27 HTTP/1.1" 200 None
2026-03-28 10:40:15 [auto1.de] INFO: Scrape type for CC34542: 2
2026-03-28 10:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542
2026-03-28 10:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9871451f-a45a-59fa-bfe7-33f472c897af with scrape type 2
2026-03-28 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9871451f-a45a-59fa-bfe7-33f472c897af with scrape type 2
2026-03-28 10:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9871451f-a45a-59fa-bfe7-33f472c897af, identifier: CC34542
2026-03-28 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_46a571f8ce5e13ef6c9d970256ba07f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:15 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-28 10:40:15 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-28 10:40:15 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-28 10:40:15 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK48222%27 HTTP/1.1" 200 None
2026-03-28 10:40:15 [auto1.de] INFO: Scrape type for FK48222: 2
2026-03-28 10:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222
2026-03-28 10:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffabbdad-2c54-5a23-a7e4-b6497662fc7a with scrape type 2
2026-03-28 10:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffabbdad-2c54-5a23-a7e4-b6497662fc7a with scrape type 2
2026-03-28 10:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffabbdad-2c54-5a23-a7e4-b6497662fc7a, identifier: FK48222
2026-03-28 10:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542
2026-03-28 10:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542
2026-03-28 10:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9871451f-a45a-59fa-bfe7-33f472c897af with identifier: CC34542 to the API
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:00:20Z',
 'fuel_type': 'petrol',
 'id': '9871451f-a45a-59fa-bfe7-33f472c897af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC34542',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 218384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-30',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2009}
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC34542%27 HTTP/1.1" 200 None
2026-03-28 10:40:15 [auto1.de] INFO: Saving data for CC34542: {'auction_closing_time': 1774882820.0, 'created_time': 1774350510.409861, 'last_price_update_time': 1774694415.869938}
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC34542') HTTP/1.1" 204 0
2026-03-28 10:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR31578> (referer: https://www.auto1.com/v1/car-details-view/LR31578/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222
2026-03-28 10:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222
2026-03-28 10:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffabbdad-2c54-5a23-a7e4-b6497662fc7a with identifier: FK48222 to the API
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:52Z',
 'fuel_type': 'petrol',
 'id': 'ffabbdad-2c54-5a23-a7e4-b6497662fc7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK48222',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 10891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-16',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK48222%27 HTTP/1.1" 200 None
2026-03-28 10:40:16 [auto1.de] INFO: Saving data for FK48222: {'auction_closing_time': 1774884712.0, 'created_time': 1773399974.619575, 'last_price_update_time': 1774694416.33153}
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK48222') HTTP/1.1" 204 0
2026-03-28 10:40:16 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-28 10:40:16 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC61131%27 HTTP/1.1" 200 None
2026-03-28 10:40:16 [auto1.de] INFO: Scrape type for WC61131: 2
2026-03-28 10:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131
2026-03-28 10:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with scrape type 2
2026-03-28 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with scrape type 2
2026-03-28 10:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9, identifier: WC61131
2026-03-28 10:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_1109578dd454673dbb508d4a51b626e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_b1b153402a2f1e3323af23ffa80682fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:16 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90826%27 HTTP/1.1" 200 None
2026-03-28 10:40:16 [auto1.de] INFO: Scrape type for KE90826: 2
2026-03-28 10:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826
2026-03-28 10:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with scrape type 2
2026-03-28 10:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with scrape type 2
2026-03-28 10:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a, identifier: KE90826
2026-03-28 10:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131
2026-03-28 10:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131
2026-03-28 10:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667bb6bd-3af4-560e-a58e-5af0ed8f57f9 with identifier: WC61131 to the API
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:26:28Z',
 'fuel_type': 'diesel',
 'id': '667bb6bd-3af4-560e-a58e-5af0ed8f57f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC61131',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 347285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-27',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2011}
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC61131%27 HTTP/1.1" 200 None
2026-03-28 10:40:16 [auto1.de] INFO: Saving data for WC61131: {'auction_closing_time': 1774884388.0, 'created_time': 1773946513.615865, 'last_price_update_time': 1774694416.894776}
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC61131') HTTP/1.1" 204 0
2026-03-28 10:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826
2026-03-28 10:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826
2026-03-28 10:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09edb6e8-1b98-5bbd-9f63-4555ecf2639a with identifier: KE90826 to the API
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:34:57Z',
 'fuel_type': 'petrol',
 'id': '09edb6e8-1b98-5bbd-9f63-4555ecf2639a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE90826',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 115776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90826%27 HTTP/1.1" 200 None
2026-03-28 10:40:17 [auto1.de] INFO: Saving data for KE90826: {'auction_closing_time': 1774884897.0, 'created_time': 1773427918.145951, 'last_price_update_time': 1774694417.26907}
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE90826') HTTP/1.1" 204 0
2026-03-28 10:40:17 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-28 10:40:17 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40839%27 HTTP/1.1" 200 None
2026-03-28 10:40:17 [auto1.de] INFO: Scrape type for RU40839: 1
2026-03-28 10:40:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfd1a50>
2026-03-28 10:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_46a571f8ce5e13ef6c9d970256ba07f5.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_46a571f8ce5e13ef6c9d970256ba07f5.jpg saved to cache
2026-03-28 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_c2829d042278782f1e3e100b7f81e638.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:17 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN93715%27 HTTP/1.1" 200 None
2026-03-28 10:40:17 [auto1.de] INFO: Scrape type for MN93715: 2
2026-03-28 10:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715
2026-03-28 10:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58e72cac-eb60-5a58-bffe-dd9676629371 with scrape type 2
2026-03-28 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58e72cac-eb60-5a58-bffe-dd9676629371 with scrape type 2
2026-03-28 10:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58e72cac-eb60-5a58-bffe-dd9676629371, identifier: MN93715
2026-03-28 10:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_a05b4819a3f7e871713c7296642ee715.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715
2026-03-28 10:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715
2026-03-28 10:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58e72cac-eb60-5a58-bffe-dd9676629371 with identifier: MN93715 to the API
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:47:34Z',
 'fuel_type': 'diesel',
 'id': '58e72cac-eb60-5a58-bffe-dd9676629371',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN93715',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 185055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-22',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN93715%27 HTTP/1.1" 200 None
2026-03-28 10:40:17 [auto1.de] INFO: Saving data for MN93715: {'auction_closing_time': 1774885654.0, 'created_time': 1774002029.850646, 'last_price_update_time': 1774694417.870222}
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN93715') HTTP/1.1" 204 0
2026-03-28 10:40:17 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-28 10:40:17 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-28 10:40:17 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC10414%27 HTTP/1.1" 200 None
2026-03-28 10:40:17 [auto1.de] INFO: Scrape type for BC10414: 2
2026-03-28 10:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414
2026-03-28 10:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2207154b-a38d-53d6-b607-c1eeff60122b with scrape type 2
2026-03-28 10:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2207154b-a38d-53d6-b607-c1eeff60122b with scrape type 2
2026-03-28 10:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2207154b-a38d-53d6-b607-c1eeff60122b, identifier: BC10414
2026-03-28 10:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578
2026-03-28 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with scrape type 1
2026-03-28 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_9b39a5eb202b03ecfff0a7f6a7b2c83d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_9b39a5eb202b03ecfff0a7f6a7b2c83d.jpg not downloaded yet
2026-03-28 10:40:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab891a910>
2026-03-28 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_1109578dd454673dbb508d4a51b626e9.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_1109578dd454673dbb508d4a51b626e9.jpg saved to cache
2026-03-28 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:40:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a70950>
2026-03-28 10:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252F45%252F5e45b4798e13af30ea686561d5bd06b3%252Fpa%252FUJ37250_b1b153402a2f1e3323af23ffa80682fa.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_b1b153402a2f1e3323af23ffa80682fa.jpg saved to cache
2026-03-28 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e56a8417-1e7d-5bca-9a99-354592d7c3b9
2026-03-28 10:40:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e56a8417-1e7d-5bca-9a99-354592d7c3b9, skipping ID generation
2026-03-28 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e56a8417-1e7d-5bca-9a99-354592d7c3b9 with scrape type 1
2026-03-28 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e56a8417-1e7d-5bca-9a99-354592d7c3b9 sending to next pipeline
2026-03-28 10:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e56a8417-1e7d-5bca-9a99-354592d7c3b9, identifier: UJ37250
2026-03-28 10:40:18 [auto1.de] INFO: Found listing with ID: YJ19312
2026-03-28 10:40:18 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68769%27 HTTP/1.1" 200 None
2026-03-28 10:40:18 [auto1.de] INFO: Scrape type for BS68769: 2
2026-03-28 10:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769
2026-03-28 10:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6330493b-dc11-593e-a743-a21e30b057eb with scrape type 2
2026-03-28 10:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6330493b-dc11-593e-a743-a21e30b057eb with scrape type 2
2026-03-28 10:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6330493b-dc11-593e-a743-a21e30b057eb, identifier: BS68769
2026-03-28 10:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414
2026-03-28 10:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414
2026-03-28 10:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2207154b-a38d-53d6-b607-c1eeff60122b with identifier: BC10414 to the API
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:32:36Z',
 'fuel_type': 'petrol',
 'id': '2207154b-a38d-53d6-b607-c1eeff60122b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC10414',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 150082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.2 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2010}
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC10414%27 HTTP/1.1" 200 None
2026-03-28 10:40:18 [auto1.de] INFO: Saving data for BC10414: {'auction_closing_time': 1774884756.0, 'created_time': 1774118564.704608, 'last_price_update_time': 1774694418.763405}
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC10414') HTTP/1.1" 204 0
2026-03-28 10:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250
2026-03-28 10:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250
2026-03-28 10:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e56a8417-1e7d-5bca-9a99-354592d7c3b9 with identifier: UJ37250 to the API
2026-03-28 10:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_b1b153402a2f1e3323af23ffa80682fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:47:06Z',
 'fuel_type': 'diesel',
 'id': 'e56a8417-1e7d-5bca-9a99-354592d7c3b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ37250',
 'listing': 'auction',
 'location': 'DE, Schwerin',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 190864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_f46d948261c1b026f80a67d1e2478ca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_46a571f8ce5e13ef6c9d970256ba07f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2691734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_1109578dd454673dbb508d4a51b626e9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743122,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_b1b153402a2f1e3323af23ffa80682fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_4c0314f4ab95b78d575bd787fa49b873.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2810362,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_a74f2ffc78e21f48b72a8718558b3e98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_a31e6c8361ba64f924deeffe17d2faf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2617085,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_372db3e3f57071125e630e1db9f2a854.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2593205,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_14e0ab66d6cda3f21ad80192947609ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e56a8417-1e7d-5bca-9a99-354592d7c3b9/e56a8417-1e7d-5bca-9a99-354592d7c3b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/45/5e45b4798e13af30ea686561d5bd06b3/pa/UJ37250_4a8513de962064607f7965606720e603.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.6 CRDi GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2015}
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ37250%27 HTTP/1.1" 200 None
2026-03-28 10:40:19 [auto1.de] INFO: Saving data for UJ37250: {'created_time': 1774694419.277646, 'last_price_update_time': 1774694419.27766, 'auction_closing_time': 1774885626.0}
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ37250') HTTP/1.1" 204 0
2026-03-28 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_f72e52b76dbab285cdb2763f4244ab31.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769
2026-03-28 10:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769
2026-03-28 10:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6330493b-dc11-593e-a743-a21e30b057eb with identifier: BS68769 to the API
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:21:22Z',
 'fuel_type': 'petrol',
 'id': '6330493b-dc11-593e-a743-a21e30b057eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS68769',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 132074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-26',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition Plus Edition',
 'transmission': 'automatic',
 'trim': 'Ambition Plus Edition',
 'year': 2012}
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68769%27 HTTP/1.1" 200 None
2026-03-28 10:40:19 [auto1.de] INFO: Saving data for BS68769: {'auction_closing_time': 1774884082.0, 'created_time': 1774032332.002269, 'last_price_update_time': 1774694419.694412}
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS68769') HTTP/1.1" 204 0
2026-03-28 10:40:19 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96250%27 HTTP/1.1" 200 None
2026-03-28 10:40:19 [auto1.de] INFO: Scrape type for LG96250: 1
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_0578ac43807bb1d54c9840f7488fb34c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_0578ac43807bb1d54c9840f7488fb34c.jpg not downloaded yet
2026-03-28 10:40:19 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-28 10:40:19 [auto1.de] INFO: Scrape type for LJ34502: 0
2026-03-28 10:40:19 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-28 10:40:19 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ68834%27 HTTP/1.1" 200 None
2026-03-28 10:40:19 [auto1.de] INFO: Scrape type for TJ68834: 2
2026-03-28 10:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834
2026-03-28 10:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with scrape type 2
2026-03-28 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with scrape type 2
2026-03-28 10:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c, identifier: TJ68834
2026-03-28 10:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE45887/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe8d990>
2026-03-28 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_c2829d042278782f1e3e100b7f81e638.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_c2829d042278782f1e3e100b7f81e638.jpg saved to cache
2026-03-28 10:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462
2026-03-28 10:40:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd45450>
2026-03-28 10:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_a05b4819a3f7e871713c7296642ee715.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_a05b4819a3f7e871713c7296642ee715.jpg saved to cache
2026-03-28 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834
2026-03-28 10:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834
2026-03-28 10:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a01dfb3-7862-56ba-9ef0-29eafcd2b52c with identifier: TJ68834 to the API
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'petrol',
 'id': '6a01dfb3-7862-56ba-9ef0-29eafcd2b52c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ68834',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 116201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-22',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ68834%27 HTTP/1.1" 200 None
2026-03-28 10:40:20 [auto1.de] INFO: Saving data for TJ68834: {'auction_closing_time': 1774885441.0, 'created_time': 1773380119.157368, 'last_price_update_time': 1774694420.39975}
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ68834') HTTP/1.1" 204 0
2026-03-28 10:40:20 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-28 10:40:20 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB27489%27 HTTP/1.1" 200 None
2026-03-28 10:40:20 [auto1.de] INFO: Scrape type for SB27489: 2
2026-03-28 10:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489
2026-03-28 10:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87524815-4ab9-5a57-802c-eb2415c14cb2 with scrape type 2
2026-03-28 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87524815-4ab9-5a57-802c-eb2415c14cb2 with scrape type 2
2026-03-28 10:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87524815-4ab9-5a57-802c-eb2415c14cb2, identifier: SB27489
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_f07211fc7d1d7cf3896adec66139e582.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_f07211fc7d1d7cf3896adec66139e582.jpg not downloaded yet
2026-03-28 10:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:20 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-28 10:40:20 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG50641%27 HTTP/1.1" 200 None
2026-03-28 10:40:20 [auto1.de] INFO: Scrape type for NG50641: 1
2026-03-28 10:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489
2026-03-28 10:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489
2026-03-28 10:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87524815-4ab9-5a57-802c-eb2415c14cb2 with identifier: SB27489 to the API
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:50Z',
 'fuel_type': 'petrol',
 'id': '87524815-4ab9-5a57-802c-eb2415c14cb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB27489',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 57395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-13',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB27489%27 HTTP/1.1" 200 None
2026-03-28 10:40:20 [auto1.de] INFO: Saving data for SB27489: {'auction_closing_time': 1774886090.0, 'created_time': 1774031770.609876, 'last_price_update_time': 1774694420.916237}
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB27489') HTTP/1.1" 204 0
2026-03-28 10:40:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88e7310>
2026-03-28 10:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg02%252F5d%252F025db8bc4bae42b53f9db041dc1f3a6f%252Fpa%252FWB94546_f72e52b76dbab285cdb2763f4244ab31.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_f72e52b76dbab285cdb2763f4244ab31.jpg saved to cache
2026-03-28 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60158439-dfbb-5db0-9278-aab9484e26aa
2026-03-28 10:40:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60158439-dfbb-5db0-9278-aab9484e26aa, skipping ID generation
2026-03-28 10:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60158439-dfbb-5db0-9278-aab9484e26aa with scrape type 1
2026-03-28 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60158439-dfbb-5db0-9278-aab9484e26aa sending to next pipeline
2026-03-28 10:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60158439-dfbb-5db0-9278-aab9484e26aa, identifier: WB94546
2026-03-28 10:40:21 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-28 10:40:21 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-28 10:40:21 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-28 10:40:21 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-28 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG97894%27 HTTP/1.1" 200 None
2026-03-28 10:40:21 [auto1.de] INFO: Scrape type for FG97894: 2
2026-03-28 10:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894
2026-03-28 10:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8008ee99-275f-5bbc-8401-d8f522dd13c1 with scrape type 2
2026-03-28 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8008ee99-275f-5bbc-8401-d8f522dd13c1 with scrape type 2
2026-03-28 10:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8008ee99-275f-5bbc-8401-d8f522dd13c1, identifier: FG97894
2026-03-28 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_bbb4a7981e55b76ffa31cf25480478c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_bbb4a7981e55b76ffa31cf25480478c2.jpg not downloaded yet
2026-03-28 10:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546
2026-03-28 10:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546
2026-03-28 10:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60158439-dfbb-5db0-9278-aab9484e26aa with identifier: WB94546 to the API
2026-03-28 10:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_f72e52b76dbab285cdb2763f4244ab31.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:49:13Z',
 'fuel_type': 'petrol',
 'id': '60158439-dfbb-5db0-9278-aab9484e26aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB94546',
 'listing': 'auction',
 'location': 'DE, Dormagen',
 'make': 'BMW',
 'model': '1er',
 'odometer': 142257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_cf2b64ff3fa14f72bd28843e71a21e47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3049541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_a033ab0da646d353cfd438bd71883bd3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3207212,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_4efc3e12c54c0a71eca724c58f3a3265.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963305,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_a05b4819a3f7e871713c7296642ee715.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_ad869b324cafd33a01afa909cdd68102.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3059975,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_f72e52b76dbab285cdb2763f4244ab31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71804,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_2626eca6bbc3bca3147a3e3d53d4ea8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3221481,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_28a949f93312449519b8a10fee163e36.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_79d8e3b46d6894c44dde71d76500bce7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60158439-dfbb-5db0-9278-aab9484e26aa/60158439-dfbb-5db0-9278-aab9484e26aa_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3179887,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img02/5d/025db8bc4bae42b53f9db041dc1f3a6f/pa/WB94546_6414939ef591054ef205eb472dbc66d7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94546%27 HTTP/1.1" 200 None
2026-03-28 10:40:22 [auto1.de] INFO: Saving data for WB94546: {'created_time': 1774694422.65219, 'last_price_update_time': 1774694422.652201, 'auction_closing_time': 1774885753.0}
2026-03-28 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB94546') HTTP/1.1" 204 0
2026-03-28 10:40:22 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-28 10:40:22 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-28 10:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894
2026-03-28 10:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894
2026-03-28 10:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8008ee99-275f-5bbc-8401-d8f522dd13c1 with identifier: FG97894 to the API
2026-03-28 10:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:04Z',
 'fuel_type': 'petrol',
 'id': '8008ee99-275f-5bbc-8401-d8f522dd13c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG97894',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 60713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-07',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 DualJet Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG97894%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [auto1.de] INFO: Saving data for FG97894: {'auction_closing_time': 1774886104.0, 'created_time': 1773341077.602483, 'last_price_update_time': 1774694423.119288}
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG97894') HTTP/1.1" 204 0
2026-03-28 10:40:23 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-28 10:40:23 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX49171%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [auto1.de] INFO: Scrape type for PX49171: 1
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_68bcb282e34c746d4edea217fb667969.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_68bcb282e34c746d4edea217fb667969.jpg not downloaded yet
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED71538> (referer: https://www.auto1.com/v1/car-details-view/ED71538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH58500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:23 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-28 10:40:23 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92609%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [auto1.de] INFO: Scrape type for SU92609: 0
2026-03-28 10:40:23 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_641cf4d8e8917468750262a40cbd4ee1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_641cf4d8e8917468750262a40cbd4ee1.jpg not downloaded yet
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_0578ac43807bb1d54c9840f7488fb34c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_f07211fc7d1d7cf3896adec66139e582.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_7846bc0b76c2204a655de1181bff7d32.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_adebc90c306e08ed2a1d76509742b17d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_adebc90c306e08ed2a1d76509742b17d.jpg not downloaded yet
2026-03-28 10:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538
2026-03-28 10:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c030561c-8927-581d-8b37-b1cfada4d831 with scrape type 1
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c030561c-8927-581d-8b37-b1cfada4d831
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_c3ce5b3bc7f5ee7e36e539a87fdd9237.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_c3ce5b3bc7f5ee7e36e539a87fdd9237.jpg not downloaded yet
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_7a83edbfb57e9302d2ac170747a1543c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_7a83edbfb57e9302d2ac170747a1543c.jpg not downloaded yet
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_05cab70dcb45b3eb39b22c1400c0402b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_05cab70dcb45b3eb39b22c1400c0402b.jpg not downloaded yet
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_fc2d00ca4d3d3c96e17d3bb559f7ad3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_fc2d00ca4d3d3c96e17d3bb559f7ad3e.jpg not downloaded yet
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_81b3f38b6153ca2fc90b1dc12c038325.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_81b3f38b6153ca2fc90b1dc12c038325.jpg not downloaded yet
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_bbb4a7981e55b76ffa31cf25480478c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_56cfd43fa0041f09c484937a8048c99f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_56cfd43fa0041f09c484937a8048c99f.jpg not downloaded yet
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_0f158293704b36b16ac291ac32b26537.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_0f158293704b36b16ac291ac32b26537.jpg not downloaded yet
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_b39857db40bb5faae9b7e44c319daa51.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_b39857db40bb5faae9b7e44c319daa51.jpg not downloaded yet
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf60110>
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_0578ac43807bb1d54c9840f7488fb34c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_0578ac43807bb1d54c9840f7488fb34c.jpg saved to cache
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef3e50>
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_f07211fc7d1d7cf3896adec66139e582.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_f07211fc7d1d7cf3896adec66139e582.jpg saved to cache
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfe9fd0>
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_7846bc0b76c2204a655de1181bff7d32.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_7846bc0b76c2204a655de1181bff7d32.jpg saved to cache
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda6a50>
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_bbb4a7981e55b76ffa31cf25480478c2.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_bbb4a7981e55b76ffa31cf25480478c2.jpg saved to cache
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_9b39a5eb202b03ecfff0a7f6a7b2c83d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_68bcb282e34c746d4edea217fb667969.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_641cf4d8e8917468750262a40cbd4ee1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_b39857db40bb5faae9b7e44c319daa51.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb4490>
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_9b39a5eb202b03ecfff0a7f6a7b2c83d.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_9b39a5eb202b03ecfff0a7f6a7b2c83d.jpg saved to cache
2026-03-28 10:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU93300/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN63274/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc22590>
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_68bcb282e34c746d4edea217fb667969.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_68bcb282e34c746d4edea217fb667969.jpg saved to cache
2026-03-28 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe43910>
2026-03-28 10:40:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_641cf4d8e8917468750262a40cbd4ee1.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_641cf4d8e8917468750262a40cbd4ee1.jpg saved to cache
2026-03-28 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf8d5d0>
2026-03-28 10:40:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_b39857db40bb5faae9b7e44c319daa51.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_b39857db40bb5faae9b7e44c319daa51.jpg saved to cache
2026-03-28 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c030561c-8927-581d-8b37-b1cfada4d831
2026-03-28 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_05cab70dcb45b3eb39b22c1400c0402b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_56cfd43fa0041f09c484937a8048c99f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_fc2d00ca4d3d3c96e17d3bb559f7ad3e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_81b3f38b6153ca2fc90b1dc12c038325.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_7a83edbfb57e9302d2ac170747a1543c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:24 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 9641 | hits on page: 40
2026-03-28 10:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_c3ce5b3bc7f5ee7e36e539a87fdd9237.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG16297%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for CG16297: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97491%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for PF97491: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY05092%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for GY05092: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74932%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for NH74932: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86018%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for PC86018: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70645%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for EE70645: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV87257%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for GV87257: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR80797%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for MR80797: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW63947%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for DW63947: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG09776%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for JG09776: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN89851%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for KN89851: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN59057%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for SN59057: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30713%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for HN30713: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX26034%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for HX26034: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM84539%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for JM84539: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA72016%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for SA72016: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR46432%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for NR46432: 0
2026-03-28 10:40:24 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-28 10:40:24 [auto1.de] INFO: Scrape type for GD21382: 2
2026-03-28 10:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382
2026-03-28 10:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a9a771-8248-5b29-b7ae-fb13f9177d58 with scrape type 2
2026-03-28 10:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53a9a771-8248-5b29-b7ae-fb13f9177d58 with scrape type 2
2026-03-28 10:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53a9a771-8248-5b29-b7ae-fb13f9177d58, identifier: GD21382
2026-03-28 10:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382
2026-03-28 10:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382
2026-03-28 10:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53a9a771-8248-5b29-b7ae-fb13f9177d58 with identifier: GD21382 to the API
2026-03-28 10:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:31:54Z',
 'fuel_type': 'diesel',
 'id': '53a9a771-8248-5b29-b7ae-fb13f9177d58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD21382',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 454600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-28 10:40:26 [auto1.de] INFO: Saving data for GD21382: {'auction_closing_time': 1774884714.0, 'created_time': 1774263760.259523, 'last_price_update_time': 1774694426.161082}
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD21382') HTTP/1.1" 204 0
2026-03-28 10:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_0f158293704b36b16ac291ac32b26537.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:26 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX76510%27 HTTP/1.1" 200 None
2026-03-28 10:40:26 [auto1.de] INFO: Scrape type for GX76510: 0
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a03c90>
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_05cab70dcb45b3eb39b22c1400c0402b.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_05cab70dcb45b3eb39b22c1400c0402b.jpg saved to cache
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c030561c-8927-581d-8b37-b1cfada4d831
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc100d0>
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_56cfd43fa0041f09c484937a8048c99f.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_56cfd43fa0041f09c484937a8048c99f.jpg saved to cache
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd37c50>
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_fc2d00ca4d3d3c96e17d3bb559f7ad3e.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_fc2d00ca4d3d3c96e17d3bb559f7ad3e.jpg saved to cache
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd1acd0>
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_81b3f38b6153ca2fc90b1dc12c038325.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_81b3f38b6153ca2fc90b1dc12c038325.jpg saved to cache
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c030561c-8927-581d-8b37-b1cfada4d831
2026-03-28 10:40:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd35310>
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_7a83edbfb57e9302d2ac170747a1543c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_7a83edbfb57e9302d2ac170747a1543c.jpg saved to cache
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba7e6190>
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_c3ce5b3bc7f5ee7e36e539a87fdd9237.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_c3ce5b3bc7f5ee7e36e539a87fdd9237.jpg saved to cache
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c030561c-8927-581d-8b37-b1cfada4d831
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a05010>
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fb7%252Fb2b73bd0c964d97d05cd4cc6bf8a4178%252Fpa%252FED71538_0f158293704b36b16ac291ac32b26537.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_0f158293704b36b16ac291ac32b26537.jpg saved to cache
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c030561c-8927-581d-8b37-b1cfada4d831
2026-03-28 10:40:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c030561c-8927-581d-8b37-b1cfada4d831, skipping ID generation
2026-03-28 10:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c030561c-8927-581d-8b37-b1cfada4d831 with scrape type 1
2026-03-28 10:40:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c030561c-8927-581d-8b37-b1cfada4d831 sending to next pipeline
2026-03-28 10:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c030561c-8927-581d-8b37-b1cfada4d831, identifier: ED71538
2026-03-28 10:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538
2026-03-28 10:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538
2026-03-28 10:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c030561c-8927-581d-8b37-b1cfada4d831 with identifier: ED71538 to the API
2026-03-28 10:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_0f158293704b36b16ac291ac32b26537.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:41:52Z',
 'fuel_type': 'diesel',
 'id': 'c030561c-8927-581d-8b37-b1cfada4d831',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED71538',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'Opel',
 'model': 'Signum',
 'odometer': 189328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92952,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_c3ce5b3bc7f5ee7e36e539a87fdd9237.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_05cab70dcb45b3eb39b22c1400c0402b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_81b3f38b6153ca2fc90b1dc12c038325.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_0f158293704b36b16ac291ac32b26537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c030561c-8927-581d-8b37-b1cfada4d831/c030561c-8927-581d-8b37-b1cfada4d831_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/b7/b2b73bd0c964d97d05cd4cc6bf8a4178/pa/ED71538_b39857db40bb5faae9b7e44c319daa51.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Signum 3.0 V6 CDTI Cosmo Plus',
 'transmission': 'automatic',
 'trim': 'Cosmo Plus',
 'year': 2007}
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED71538%27 HTTP/1.1" 200 None
2026-03-28 10:40:27 [auto1.de] INFO: Saving data for ED71538: {'created_time': 1774694427.498074, 'last_price_update_time': 1774694427.498084, 'auction_closing_time': 1774885312.0}
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED71538') HTTP/1.1" 204 0
2026-03-28 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_a57fafdb2e5f6e3d3c43f6833aa3709c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_adebc90c306e08ed2a1d76509742b17d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba7e6d10>
2026-03-28 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_a57fafdb2e5f6e3d3c43f6833aa3709c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_a57fafdb2e5f6e3d3c43f6833aa3709c.jpg saved to cache
2026-03-28 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462
2026-03-28 10:40:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a07690>
2026-03-28 10:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fee%252F2dee22d0c18421f1e6fd6e81f5da246d%252Fpa%252FLR31578_adebc90c306e08ed2a1d76509742b17d.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_adebc90c306e08ed2a1d76509742b17d.jpg saved to cache
2026-03-28 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37
2026-03-28 10:40:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c323a7b-2b9c-5b6a-94ee-70c153456f37, skipping ID generation
2026-03-28 10:40:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with scrape type 1
2026-03-28 10:40:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c323a7b-2b9c-5b6a-94ee-70c153456f37 sending to next pipeline
2026-03-28 10:40:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c323a7b-2b9c-5b6a-94ee-70c153456f37, identifier: LR31578
2026-03-28 10:40:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578
2026-03-28 10:40:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578
2026-03-28 10:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c323a7b-2b9c-5b6a-94ee-70c153456f37 with identifier: LR31578 to the API
2026-03-28 10:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_adebc90c306e08ed2a1d76509742b17d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:55:39Z',
 'fuel_type': 'petrol',
 'id': '2c323a7b-2b9c-5b6a-94ee-70c153456f37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR31578',
 'listing': 'auction',
 'location': 'DE, Zweibrücken',
 'make': 'Mazda',
 'model': 'MX-5',
 'odometer': 72914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589115,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_9b39a5eb202b03ecfff0a7f6a7b2c83d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_0578ac43807bb1d54c9840f7488fb34c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_f07211fc7d1d7cf3896adec66139e582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_bbb4a7981e55b76ffa31cf25480478c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_68bcb282e34c746d4edea217fb667969.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2417141,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_641cf4d8e8917468750262a40cbd4ee1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2176226,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_adebc90c306e08ed2a1d76509742b17d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2815529,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_7a83edbfb57e9302d2ac170747a1543c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_fc2d00ca4d3d3c96e17d3bb559f7ad3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c323a7b-2b9c-5b6a-94ee-70c153456f37/2c323a7b-2b9c-5b6a-94ee-70c153456f37_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/ee/2dee22d0c18421f1e6fd6e81f5da246d/pa/LR31578_56cfd43fa0041f09c484937a8048c99f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-11-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mazda MX-5 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2017}
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-28 10:40:28 [auto1.de] INFO: Saving data for LR31578: {'created_time': 1774694428.223475, 'last_price_update_time': 1774694428.223489, 'auction_closing_time': 1774886139.0}
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR31578') HTTP/1.1" 204 0
2026-03-28 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_b1ecfdb166c1b7c5163bacdd721a6cda.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_3f5bed5311914ae036d9eaa7c59027b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf90910>
2026-03-28 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_b1ecfdb166c1b7c5163bacdd721a6cda.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_b1ecfdb166c1b7c5163bacdd721a6cda.jpg saved to cache
2026-03-28 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462
2026-03-28 10:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe82c50>
2026-03-28 10:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg21%252F18%252F211870a7931a6e74df4226165433f7c5%252Fpa%252FDF72133_3f5bed5311914ae036d9eaa7c59027b1.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_3f5bed5311914ae036d9eaa7c59027b1.jpg saved to cache
2026-03-28 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462
2026-03-28 10:40:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cabc91e-0795-5c0e-ad1c-02fa29af5462, skipping ID generation
2026-03-28 10:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with scrape type 1
2026-03-28 10:40:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cabc91e-0795-5c0e-ad1c-02fa29af5462 sending to next pipeline
2026-03-28 10:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cabc91e-0795-5c0e-ad1c-02fa29af5462, identifier: DF72133
2026-03-28 10:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133
2026-03-28 10:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133
2026-03-28 10:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cabc91e-0795-5c0e-ad1c-02fa29af5462 with identifier: DF72133 to the API
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_3f5bed5311914ae036d9eaa7c59027b1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:03:43Z',
 'fuel_type': 'petrol',
 'id': '8cabc91e-0795-5c0e-ad1c-02fa29af5462',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF72133',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 191741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_a753aa5c5178d3cf3a575714a320bec9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_b1ecfdb166c1b7c5163bacdd721a6cda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_3f5bed5311914ae036d9eaa7c59027b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70994,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_a57fafdb2e5f6e3d3c43f6833aa3709c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 131547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_7846bc0b76c2204a655de1181bff7d32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cabc91e-0795-5c0e-ad1c-02fa29af5462/8cabc91e-0795-5c0e-ad1c-02fa29af5462_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img21/18/211870a7931a6e74df4226165433f7c5/pa/DF72133_c2829d042278782f1e3e100b7f81e638.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2013}
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF72133%27 HTTP/1.1" 200 None
2026-03-28 10:40:29 [auto1.de] INFO: Saving data for DF72133: {'created_time': 1774694429.0128, 'last_price_update_time': 1774694429.012816, 'auction_closing_time': 1774883023.0}
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF72133') HTTP/1.1" 204 0
2026-03-28 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV63958/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU40839/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_2b810f71a484cf0758e4344538949eb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_4465e5bdf511e5b8e1c84a1b35bfc3fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_e2dbf58fc648a0e18840634e661ac327.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd22810>
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_2b810f71a484cf0758e4344538949eb7.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_2b810f71a484cf0758e4344538949eb7.jpg saved to cache
2026-03-28 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7fc5a3a0-9801-53af-970f-10ff26ba3835
2026-03-28 10:40:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabef14d0>
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_4465e5bdf511e5b8e1c84a1b35bfc3fc.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_4465e5bdf511e5b8e1c84a1b35bfc3fc.jpg saved to cache
2026-03-28 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc07d0>
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_e2dbf58fc648a0e18840634e661ac327.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_e2dbf58fc648a0e18840634e661ac327.jpg saved to cache
2026-03-28 10:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ47645> (referer: https://www.auto1.com/v1/car-details-view/PJ47645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645
2026-03-28 10:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e16d97-69df-547f-aced-383070789b22 with scrape type 1
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 68e16d97-69df-547f-aced-383070789b22
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_3e531a73515fa192379fcae47454fa72.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_3e531a73515fa192379fcae47454fa72.jpg not downloaded yet
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_ba79a3be068f8c7ecabd56e53aecc841.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_ba79a3be068f8c7ecabd56e53aecc841.jpg not downloaded yet
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_eaa939e07b7cd0cdf8e80d6651965c7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_eaa939e07b7cd0cdf8e80d6651965c7d.jpg not downloaded yet
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_6f134491b0418e282b4ddc8da7d6eb52.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_6f134491b0418e282b4ddc8da7d6eb52.jpg not downloaded yet
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_3ddbe008490e0075818a53b140b0101e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_3ddbe008490e0075818a53b140b0101e.jpg not downloaded yet
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_7b21aef7267ca244a0182140936b1f7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_7b21aef7267ca244a0182140936b1f7e.jpg not downloaded yet
2026-03-28 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE45887> (referer: https://www.auto1.com/v1/car-details-view/NE45887/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_183a298b095f5b07373a935e6ed1a190.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH58500> (referer: https://www.auto1.com/v1/car-details-view/BH58500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_7b21aef7267ca244a0182140936b1f7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_3ddbe008490e0075818a53b140b0101e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887
2026-03-28 10:40:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 811247cf-65bd-5002-8eeb-49c701a816ee with scrape type 1
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 811247cf-65bd-5002-8eeb-49c701a816ee
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_f01168ef0116ae7cbf774678fe84801a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_f01168ef0116ae7cbf774678fe84801a.jpg already downloaded
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_eb078e9c907318a74141ec164bda4e24.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_eb078e9c907318a74141ec164bda4e24.jpg already downloaded
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_7e474916eabcd670eaded23e2fca866a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_7e474916eabcd670eaded23e2fca866a.jpg already downloaded
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_09ffd76bfa345447122ba23d280636a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_09ffd76bfa345447122ba23d280636a7.jpg already downloaded
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_3129c350180dba71cfd6290be147a26f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_3129c350180dba71cfd6290be147a26f.jpg already downloaded
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_d1f8103707db0e9b49073934dde5fbe2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_d1f8103707db0e9b49073934dde5fbe2.jpg already downloaded
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_7b7a1e3279f537cc39060133e9976df0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_7b7a1e3279f537cc39060133e9976df0.jpg already downloaded
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_31da550d1cf9de36e97fba41befc7700.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_31da550d1cf9de36e97fba41befc7700.jpg already downloaded
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_e6a5a0a75e8de1df145ac765e4e9fd3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_e6a5a0a75e8de1df145ac765e4e9fd3f.jpg already downloaded
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9e%252F48%252F9e4830cf8ff30c7bcbac29f0db72caf8%252Fpa%252FNE45887_6758e3149d8dfffc18c3fd2f48b9d4f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_6758e3149d8dfffc18c3fd2f48b9d4f8.jpg already downloaded
2026-03-28 10:40:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 811247cf-65bd-5002-8eeb-49c701a816ee, identifier: NE45887
2026-03-28 10:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887
2026-03-28 10:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887
2026-03-28 10:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 811247cf-65bd-5002-8eeb-49c701a816ee with identifier: NE45887 to the API
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NE45887>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:07Z',
 'fuel_type': 'petrol',
 'id': '811247cf-65bd-5002-8eeb-49c701a816ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE45887',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 21797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_f01168ef0116ae7cbf774678fe84801a.jpg',
                'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_eb078e9c907318a74141ec164bda4e24.jpg',
                'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_7e474916eabcd670eaded23e2fca866a.jpg',
                'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_09ffd76bfa345447122ba23d280636a7.jpg',
                'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_3129c350180dba71cfd6290be147a26f.jpg',
                'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_d1f8103707db0e9b49073934dde5fbe2.jpg',
                'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_7b7a1e3279f537cc39060133e9976df0.jpg',
                'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_31da550d1cf9de36e97fba41befc7700.jpg',
                'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_e6a5a0a75e8de1df145ac765e4e9fd3f.jpg',
                'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_6758e3149d8dfffc18c3fd2f48b9d4f8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_f01168ef0116ae7cbf774678fe84801a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_eb078e9c907318a74141ec164bda4e24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_7e474916eabcd670eaded23e2fca866a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_09ffd76bfa345447122ba23d280636a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_3129c350180dba71cfd6290be147a26f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_d1f8103707db0e9b49073934dde5fbe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_7b7a1e3279f537cc39060133e9976df0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_31da550d1cf9de36e97fba41befc7700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_e6a5a0a75e8de1df145ac765e4e9fd3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_811247cf-65bd-5002-8eeb-49c701a816ee/811247cf-65bd-5002-8eeb-49c701a816ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9e/48/9e4830cf8ff30c7bcbac29f0db72caf8/pa/NE45887_6758e3149d8dfffc18c3fd2f48b9d4f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 eTSI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2024}
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-28 10:40:31 [auto1.de] INFO: Saving data for NE45887: {'created_time': 1774694431.942245, 'last_price_update_time': 1774694431.942258, 'auction_closing_time': 1774883647.0}
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE45887') HTTP/1.1" 204 0
2026-03-28 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_ba79a3be068f8c7ecabd56e53aecc841.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_6f134491b0418e282b4ddc8da7d6eb52.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_eaa939e07b7cd0cdf8e80d6651965c7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8908110>
2026-03-28 10:40:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_183a298b095f5b07373a935e6ed1a190.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_183a298b095f5b07373a935e6ed1a190.jpg saved to cache
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500
2026-03-28 10:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef4b9696-1893-5928-a415-06ae470f0d36 with scrape type 1
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_1aa33492cce9c8d0fd8c43dcab2a69b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_1aa33492cce9c8d0fd8c43dcab2a69b3.jpg not downloaded yet
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd23c90>
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_7b21aef7267ca244a0182140936b1f7e.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_7b21aef7267ca244a0182140936b1f7e.jpg saved to cache
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 68e16d97-69df-547f-aced-383070789b22
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabefde50>
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_3ddbe008490e0075818a53b140b0101e.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_3ddbe008490e0075818a53b140b0101e.jpg saved to cache
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68e16d97-69df-547f-aced-383070789b22
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_48e71eb1b1df6dad1ce7312bdb01f54b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_48e71eb1b1df6dad1ce7312bdb01f54b.jpg not downloaded yet
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb9710>
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_ba79a3be068f8c7ecabd56e53aecc841.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_ba79a3be068f8c7ecabd56e53aecc841.jpg saved to cache
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68e16d97-69df-547f-aced-383070789b22
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd5b910>
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_6f134491b0418e282b4ddc8da7d6eb52.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_6f134491b0418e282b4ddc8da7d6eb52.jpg saved to cache
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68e16d97-69df-547f-aced-383070789b22
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a02b90>
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_eaa939e07b7cd0cdf8e80d6651965c7d.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_eaa939e07b7cd0cdf8e80d6651965c7d.jpg saved to cache
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 68e16d97-69df-547f-aced-383070789b22
2026-03-28 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_8a075cc4a7fe9f5423ce0ca349ca0786.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_7127a01e590c207f320dad4c5ab77e0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_7127a01e590c207f320dad4c5ab77e0a.jpg not downloaded yet
2026-03-28 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_3e531a73515fa192379fcae47454fa72.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_14b8187def388d1c6d94bb74e1a0ae55.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_14b8187def388d1c6d94bb74e1a0ae55.jpg not downloaded yet
2026-03-28 10:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN63274> (referer: https://www.auto1.com/v1/car-details-view/TN63274/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_aa8abfc8e75de003bea5eab7fbed8154.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_aa8abfc8e75de003bea5eab7fbed8154.jpg not downloaded yet
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_3311b21e6f67a4f049649fbbb7b3f188.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_3311b21e6f67a4f049649fbbb7b3f188.jpg not downloaded yet
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_df62f87ba4473b7eb208c82a86d5707a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_df62f87ba4473b7eb208c82a86d5707a.jpg not downloaded yet
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf8e350>
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_8a075cc4a7fe9f5423ce0ca349ca0786.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_8a075cc4a7fe9f5423ce0ca349ca0786.jpg saved to cache
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_30c5cc66d88b5df6cd336fc2cd95d7fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_30c5cc66d88b5df6cd336fc2cd95d7fb.jpg not downloaded yet
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_f846d0bc4ecfc224497fd9d884bb8a97.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_f846d0bc4ecfc224497fd9d884bb8a97.jpg not downloaded yet
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_c8c30eaed5a10bf3312e7bb07d833ae1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_c8c30eaed5a10bf3312e7bb07d833ae1.jpg not downloaded yet
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf58910>
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4a%252Fe0%252F4ae007582f5e43984bfe48c331bc3517%252Fpa%252FPJ47645_3e531a73515fa192379fcae47454fa72.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_3e531a73515fa192379fcae47454fa72.jpg saved to cache
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68e16d97-69df-547f-aced-383070789b22
2026-03-28 10:40:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 68e16d97-69df-547f-aced-383070789b22, skipping ID generation
2026-03-28 10:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68e16d97-69df-547f-aced-383070789b22 with scrape type 1
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 68e16d97-69df-547f-aced-383070789b22 sending to next pipeline
2026-03-28 10:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68e16d97-69df-547f-aced-383070789b22, identifier: PJ47645
2026-03-28 10:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274
2026-03-28 10:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with scrape type 1
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_6d3d468414a3a964556353a2c908e9bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_6d3d468414a3a964556353a2c908e9bf.jpg already downloaded
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_0d4baa057a05b95cb4215e0de87f79d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_0d4baa057a05b95cb4215e0de87f79d0.jpg already downloaded
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_78b7023cd5fe89afa6fa2b456a83c5ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_78b7023cd5fe89afa6fa2b456a83c5ad.jpg already downloaded
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_d47515fd40107d6b8fc6e80410232567.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_d47515fd40107d6b8fc6e80410232567.jpg already downloaded
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_fe2b07738b44505bf43f2e1bcebe99a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_fe2b07738b44505bf43f2e1bcebe99a2.jpg already downloaded
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_5d0bafe4cbad6f6302a7d7e08edde3b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_5d0bafe4cbad6f6302a7d7e08edde3b4.jpg already downloaded
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_22accd95de397c38eef644c4bc745a85.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_22accd95de397c38eef644c4bc745a85.jpg already downloaded
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_f8721fd786b58d3095071422d10dca10.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_f8721fd786b58d3095071422d10dca10.jpg already downloaded
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_c513fec38effdbdd33de0eb12791e4ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_c513fec38effdbdd33de0eb12791e4ab.jpg already downloaded
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F74%252Fd674c8f16f4d9a0a3f559cd508e8100f%252Fpa%252FTN63274_cfa74a5e2470041d158403434055d7e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_cfa74a5e2470041d158403434055d7e1.jpg already downloaded
2026-03-28 10:40:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5, identifier: TN63274
2026-03-28 10:40:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645
2026-03-28 10:40:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645
2026-03-28 10:40:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68e16d97-69df-547f-aced-383070789b22 with identifier: PJ47645 to the API
2026-03-28 10:40:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_3e531a73515fa192379fcae47454fa72.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:47Z',
 'fuel_type': 'petrol',
 'id': '68e16d97-69df-547f-aced-383070789b22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ47645',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 162954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_3e531a73515fa192379fcae47454fa72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_ba79a3be068f8c7ecabd56e53aecc841.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_eaa939e07b7cd0cdf8e80d6651965c7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_6f134491b0418e282b4ddc8da7d6eb52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_3ddbe008490e0075818a53b140b0101e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68e16d97-69df-547f-aced-383070789b22/68e16d97-69df-547f-aced-383070789b22_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4a/e0/4ae007582f5e43984bfe48c331bc3517/pa/PJ47645_7b21aef7267ca244a0182140936b1f7e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ47645%27 HTTP/1.1" 200 None
2026-03-28 10:40:33 [auto1.de] INFO: Saving data for PJ47645: {'created_time': 1774694433.273251, 'last_price_update_time': 1774694433.273262, 'auction_closing_time': 1774883927.0}
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ47645') HTTP/1.1" 204 0
2026-03-28 10:40:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274
2026-03-28 10:40:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274
2026-03-28 10:40:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c2e3bfb-24e1-5e24-af36-0dc40b215ad5 with identifier: TN63274 to the API
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TN63274>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:00:39Z',
 'fuel_type': 'petrol',
 'id': '7c2e3bfb-24e1-5e24-af36-0dc40b215ad5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN63274',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 84969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_6d3d468414a3a964556353a2c908e9bf.jpg',
                'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_0d4baa057a05b95cb4215e0de87f79d0.jpg',
                'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_78b7023cd5fe89afa6fa2b456a83c5ad.jpg',
                'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_d47515fd40107d6b8fc6e80410232567.jpg',
                'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_fe2b07738b44505bf43f2e1bcebe99a2.jpg',
                'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_5d0bafe4cbad6f6302a7d7e08edde3b4.jpg',
                'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_22accd95de397c38eef644c4bc745a85.jpg',
                'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_f8721fd786b58d3095071422d10dca10.jpg',
                'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_c513fec38effdbdd33de0eb12791e4ab.jpg',
                'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_cfa74a5e2470041d158403434055d7e1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_6d3d468414a3a964556353a2c908e9bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_0d4baa057a05b95cb4215e0de87f79d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_78b7023cd5fe89afa6fa2b456a83c5ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58264,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_d47515fd40107d6b8fc6e80410232567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596059,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_fe2b07738b44505bf43f2e1bcebe99a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2747763,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_5d0bafe4cbad6f6302a7d7e08edde3b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_22accd95de397c38eef644c4bc745a85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_f8721fd786b58d3095071422d10dca10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2287099,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_c513fec38effdbdd33de0eb12791e4ab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c2e3bfb-24e1-5e24-af36-0dc40b215ad5/7c2e3bfb-24e1-5e24-af36-0dc40b215ad5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2819207,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/74/d674c8f16f4d9a0a3f559cd508e8100f/pa/TN63274_cfa74a5e2470041d158403434055d7e1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Exclusive-Line',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line',
 'year': 2019}
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63274%27 HTTP/1.1" 200 None
2026-03-28 10:40:33 [auto1.de] INFO: Saving data for TN63274: {'created_time': 1774694433.660176, 'last_price_update_time': 1774694433.660188, 'auction_closing_time': 1774882839.0}
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN63274') HTTP/1.1" 204 0
2026-03-28 10:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_48e71eb1b1df6dad1ce7312bdb01f54b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DS20438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_14b8187def388d1c6d94bb74e1a0ae55.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_1aa33492cce9c8d0fd8c43dcab2a69b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda4590>
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_48e71eb1b1df6dad1ce7312bdb01f54b.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_48e71eb1b1df6dad1ce7312bdb01f54b.jpg saved to cache
2026-03-28 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88bead0>
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_14b8187def388d1c6d94bb74e1a0ae55.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_14b8187def388d1c6d94bb74e1a0ae55.jpg saved to cache
2026-03-28 10:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfbd610>
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_1aa33492cce9c8d0fd8c43dcab2a69b3.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_1aa33492cce9c8d0fd8c43dcab2a69b3.jpg saved to cache
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_f846d0bc4ecfc224497fd9d884bb8a97.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_30c5cc66d88b5df6cd336fc2cd95d7fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_c8c30eaed5a10bf3312e7bb07d833ae1.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_df62f87ba4473b7eb208c82a86d5707a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe999d0>
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_f846d0bc4ecfc224497fd9d884bb8a97.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_f846d0bc4ecfc224497fd9d884bb8a97.jpg saved to cache
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd31a50>
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_30c5cc66d88b5df6cd336fc2cd95d7fb.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_30c5cc66d88b5df6cd336fc2cd95d7fb.jpg saved to cache
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd74bd0>
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_c8c30eaed5a10bf3312e7bb07d833ae1.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_c8c30eaed5a10bf3312e7bb07d833ae1.jpg saved to cache
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc2b610>
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_df62f87ba4473b7eb208c82a86d5707a.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_df62f87ba4473b7eb208c82a86d5707a.jpg saved to cache
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_aa8abfc8e75de003bea5eab7fbed8154.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_3311b21e6f67a4f049649fbbb7b3f188.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_7127a01e590c207f320dad4c5ab77e0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_6ed1fbce656468c1f1ef22a951056417.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_20b5a681ceca29535e60915b75b9b8ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba79c510>
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_aa8abfc8e75de003bea5eab7fbed8154.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_aa8abfc8e75de003bea5eab7fbed8154.jpg saved to cache
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc4c90>
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_3311b21e6f67a4f049649fbbb7b3f188.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_3311b21e6f67a4f049649fbbb7b3f188.jpg saved to cache
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab892a390>
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F24%252F22245a0f78f77445036bd8655698f09b%252Fpa%252FBH58500_7127a01e590c207f320dad4c5ab77e0a.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_7127a01e590c207f320dad4c5ab77e0a.jpg saved to cache
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef4b9696-1893-5928-a415-06ae470f0d36
2026-03-28 10:40:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef4b9696-1893-5928-a415-06ae470f0d36, skipping ID generation
2026-03-28 10:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef4b9696-1893-5928-a415-06ae470f0d36 with scrape type 1
2026-03-28 10:40:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef4b9696-1893-5928-a415-06ae470f0d36 sending to next pipeline
2026-03-28 10:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef4b9696-1893-5928-a415-06ae470f0d36, identifier: BH58500
2026-03-28 10:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500
2026-03-28 10:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500
2026-03-28 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef4b9696-1893-5928-a415-06ae470f0d36 with identifier: BH58500 to the API
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_7127a01e590c207f320dad4c5ab77e0a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:06:56Z',
 'fuel_type': 'diesel',
 'id': 'ef4b9696-1893-5928-a415-06ae470f0d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH58500',
 'listing': 'auction',
 'location': 'DE, Markkleeberg',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 158619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3328247,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_1aa33492cce9c8d0fd8c43dcab2a69b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_48e71eb1b1df6dad1ce7312bdb01f54b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3143852,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_7127a01e590c207f320dad4c5ab77e0a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3066645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_14b8187def388d1c6d94bb74e1a0ae55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_aa8abfc8e75de003bea5eab7fbed8154.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065985,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_3311b21e6f67a4f049649fbbb7b3f188.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_df62f87ba4473b7eb208c82a86d5707a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_30c5cc66d88b5df6cd336fc2cd95d7fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_f846d0bc4ecfc224497fd9d884bb8a97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4b9696-1893-5928-a415-06ae470f0d36/ef4b9696-1893-5928-a415-06ae470f0d36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3382424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img22/24/22245a0f78f77445036bd8655698f09b/pa/BH58500_c8c30eaed5a10bf3312e7bb07d833ae1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-28 10:40:35 [auto1.de] INFO: Saving data for BH58500: {'created_time': 1774694435.327649, 'last_price_update_time': 1774694435.327661, 'auction_closing_time': 1774883216.0}
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH58500') HTTP/1.1" 204 0
2026-03-28 10:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd76cd0>
2026-03-28 10:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F67%252Fd167500e55329f8f823a905b21f048b7%252Fpa%252FSY64199_6ed1fbce656468c1f1ef22a951056417.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_6ed1fbce656468c1f1ef22a951056417.jpg saved to cache
2026-03-28 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7fc5a3a0-9801-53af-970f-10ff26ba3835
2026-03-28 10:40:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fc5a3a0-9801-53af-970f-10ff26ba3835, skipping ID generation
2026-03-28 10:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fc5a3a0-9801-53af-970f-10ff26ba3835 with scrape type 1
2026-03-28 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7fc5a3a0-9801-53af-970f-10ff26ba3835 sending to next pipeline
2026-03-28 10:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fc5a3a0-9801-53af-970f-10ff26ba3835, identifier: SY64199
2026-03-28 10:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc20590>
2026-03-28 10:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb1%252F38%252Fb138af95bfb0f2f5d1b7c9eded8c1f09%252Fpa%252FJM74850_20b5a681ceca29535e60915b75b9b8ef.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_20b5a681ceca29535e60915b75b9b8ef.jpg saved to cache
2026-03-28 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3eb70cd-2042-5bf9-90f8-52567c64b389
2026-03-28 10:40:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3eb70cd-2042-5bf9-90f8-52567c64b389, skipping ID generation
2026-03-28 10:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3eb70cd-2042-5bf9-90f8-52567c64b389 with scrape type 1
2026-03-28 10:40:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3eb70cd-2042-5bf9-90f8-52567c64b389 sending to next pipeline
2026-03-28 10:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3eb70cd-2042-5bf9-90f8-52567c64b389, identifier: JM74850
2026-03-28 10:40:35 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 9641 | hits on page: 40
2026-03-28 10:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199
2026-03-28 10:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199
2026-03-28 10:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fc5a3a0-9801-53af-970f-10ff26ba3835 with identifier: SY64199 to the API
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_6ed1fbce656468c1f1ef22a951056417.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:07:04Z',
 'fuel_type': 'petrol',
 'id': '7fc5a3a0-9801-53af-970f-10ff26ba3835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY64199',
 'listing': 'auction',
 'location': 'DE, Bocholt',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 182142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_63f73e03111ac1771da8fc3a10bb9718.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_6ed1fbce656468c1f1ef22a951056417.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_4821baa638c69975eb5a28fad830d428.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_2b810f71a484cf0758e4344538949eb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fc5a3a0-9801-53af-970f-10ff26ba3835/7fc5a3a0-9801-53af-970f-10ff26ba3835_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/67/d167500e55329f8f823a905b21f048b7/pa/SY64199_5311bbfae1f1bf623c716432de2a1660.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY64199%27 HTTP/1.1" 200 None
2026-03-28 10:40:35 [auto1.de] INFO: Saving data for SY64199: {'created_time': 1774694435.998221, 'last_price_update_time': 1774694435.998235, 'auction_closing_time': 1774883224.0}
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY64199') HTTP/1.1" 204 0
2026-03-28 10:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850
2026-03-28 10:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850
2026-03-28 10:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3eb70cd-2042-5bf9-90f8-52567c64b389 with identifier: JM74850 to the API
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_20b5a681ceca29535e60915b75b9b8ef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:08:39Z',
 'fuel_type': 'diesel',
 'id': 'b3eb70cd-2042-5bf9-90f8-52567c64b389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM74850',
 'listing': 'auction',
 'location': 'DE, Bad Bevensen',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 141603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3108900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_42d30f7b9aa95a93c6c6d4237dbb521b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_20b5a681ceca29535e60915b75b9b8ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_183a298b095f5b07373a935e6ed1a190.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2961815,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_4465e5bdf511e5b8e1c84a1b35bfc3fc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_65e3d7cb392d424790b7f9b335725632.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_2c03cacdc9107333dd474a477cb6d38f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_d08cfa735c5fcf842c339bc980c7ef4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_17a6370404d18742d2e67585f2c140f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_bb92d4bad7e3a65bc3d31743fd7668af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3eb70cd-2042-5bf9-90f8-52567c64b389/b3eb70cd-2042-5bf9-90f8-52567c64b389_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48863,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb1/38/b138af95bfb0f2f5d1b7c9eded8c1f09/pa/JM74850_fdc321e43fe841de4463a7004b780806.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.7 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2011}
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM74850%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Saving data for JM74850: {'created_time': 1774694436.370204, 'last_price_update_time': 1774694436.370215, 'auction_closing_time': 1774883319.0}
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM74850') HTTP/1.1" 204 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT67052%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for DT67052: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX36608%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for YX36608: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR58634%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for HR58634: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM22131%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for LM22131: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for UE63664: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: SR82375
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: FH90697
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: YV38391
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: WB33854
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB33854%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for WB33854: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: XE46726
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: KG17192
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG17192%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for KG17192: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: NW69156
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13767%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for GP13767: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX83538%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for VX83538: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: SG07809
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79611%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for AM79611: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY28796%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for ZY28796: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD81240%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for AD81240: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK52419%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for RK52419: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT54020%27 HTTP/1.1" 200 None
2026-03-28 10:40:36 [auto1.de] INFO: Scrape type for XT54020: 0
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: YD03846
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-28 10:40:36 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 10:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_d2930acddd9dd742ac376facd9c23a5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe16ad0>
2026-03-28 10:40:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F94%252Fd194e1bb29b19797be099fc27859dfef%252Fpa%252FGF54285_d2930acddd9dd742ac376facd9c23a5b.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_d2930acddd9dd742ac376facd9c23a5b.jpg saved to cache
2026-03-28 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9f338615-b78e-533c-a800-4bc3378e5914
2026-03-28 10:40:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9f338615-b78e-533c-a800-4bc3378e5914, skipping ID generation
2026-03-28 10:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f338615-b78e-533c-a800-4bc3378e5914 with scrape type 1
2026-03-28 10:40:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9f338615-b78e-533c-a800-4bc3378e5914 sending to next pipeline
2026-03-28 10:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f338615-b78e-533c-a800-4bc3378e5914, identifier: GF54285
2026-03-28 10:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285
2026-03-28 10:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285
2026-03-28 10:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f338615-b78e-533c-a800-4bc3378e5914 with identifier: GF54285 to the API
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_d2930acddd9dd742ac376facd9c23a5b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 254,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '3.4L',
 'engine_horse_power': 295,
 'expiration_date': '2026-03-30T15:11:09Z',
 'fuel_type': 'petrol',
 'id': '9f338615-b78e-533c-a800-4bc3378e5914',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF54285',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Porsche',
 'model': 'Cayman',
 'odometer': 59722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2451422,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_a9c99f62c5f82357b4145430ba55da75.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_d2930acddd9dd742ac376facd9c23a5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62152,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_8a075cc4a7fe9f5423ce0ca349ca0786.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_e2dbf58fc648a0e18840634e661ac327.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_94b611a4b611180877e5cf37da6fd6ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_f5bab0a413abd29172fd265d29a10608.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_7602d5e31ef6d7d98ace40bde0241abf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_52fb7fab7f14a38d758c3fb8c4c59196.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_8148e794d1a0d3043150cf278a49f38c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9f338615-b78e-533c-a800-4bc3378e5914/9f338615-b78e-533c-a800-4bc3378e5914_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/94/d194e1bb29b19797be099fc27859dfef/pa/GF54285_4cf6fe82dacd25d3a2c1db8105508714.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-24',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Porsche Cayman S',
 'transmission': 'manual',
 'trim': '',
 'year': 2005}
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54285%27 HTTP/1.1" 200 None
2026-03-28 10:40:37 [auto1.de] INFO: Saving data for GF54285: {'created_time': 1774694437.31208, 'last_price_update_time': 1774694437.31209, 'auction_closing_time': 1774883469.0}
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF54285') HTTP/1.1" 204 0
2026-03-28 10:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VY67413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU93693/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG96250/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ98908/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG50641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PX49171/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE90423/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV63958> (referer: https://www.auto1.com/v1/car-details-view/ZV63958/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958
2026-03-28 10:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab3ec60-1e85-5c08-be19-0ac6f7c02853 with scrape type 1
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_c4bd06b4c1cb19431207e3e38b21bafe.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_c4bd06b4c1cb19431207e3e38b21bafe.jpg not downloaded yet
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_9a81e07aae860ecd44e9652a6be77cee.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_9a81e07aae860ecd44e9652a6be77cee.jpg not downloaded yet
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_79828dd5a016a333ce534efd8538b49c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_79828dd5a016a333ce534efd8538b49c.jpg not downloaded yet
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_3c0164ac1c11a1e03b00aa854fe4ab99.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_3c0164ac1c11a1e03b00aa854fe4ab99.jpg not downloaded yet
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_46eb6461906aa4221a1aac6675e6f087.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_46eb6461906aa4221a1aac6675e6f087.jpg not downloaded yet
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_e8473859a7f049c22bebaebc21ec345a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_e8473859a7f049c22bebaebc21ec345a.jpg not downloaded yet
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_0c60da5755296c81e4d7835090233db6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_0c60da5755296c81e4d7835090233db6.jpg not downloaded yet
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_b6843632305acc048966ae5daf0f365e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_b6843632305acc048966ae5daf0f365e.jpg not downloaded yet
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_178e4d6026569b0f3cf82f7089bfd52a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_178e4d6026569b0f3cf82f7089bfd52a.jpg not downloaded yet
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_9e81feb16d0eaa93cd039384f91eb49a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_9e81feb16d0eaa93cd039384f91eb49a.jpg not downloaded yet
2026-03-28 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_c4bd06b4c1cb19431207e3e38b21bafe.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabefe090>
2026-03-28 10:40:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_c4bd06b4c1cb19431207e3e38b21bafe.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_c4bd06b4c1cb19431207e3e38b21bafe.jpg saved to cache
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_9e81feb16d0eaa93cd039384f91eb49a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf8c3d0>
2026-03-28 10:40:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_9e81feb16d0eaa93cd039384f91eb49a.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_9e81feb16d0eaa93cd039384f91eb49a.jpg saved to cache
2026-03-28 10:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SH00876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_178e4d6026569b0f3cf82f7089bfd52a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU40839> (referer: https://www.auto1.com/v1/car-details-view/RU40839/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU93300> (referer: https://www.auto1.com/v1/car-details-view/TU93300/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabefced0>
2026-03-28 10:40:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_178e4d6026569b0f3cf82f7089bfd52a.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_178e4d6026569b0f3cf82f7089bfd52a.jpg saved to cache
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_b6843632305acc048966ae5daf0f365e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839
2026-03-28 10:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with scrape type 1
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ab06a83-ca1b-5684-abdd-5a53f38de1ea
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_3f8ae8daf22023c82286ffa3cf7aaa5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_3f8ae8daf22023c82286ffa3cf7aaa5b.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_312af361c9a066a6a0ee9015f8db6aed.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_312af361c9a066a6a0ee9015f8db6aed.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_39a2b710dcd617cb0925578f30301f1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_39a2b710dcd617cb0925578f30301f1c.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_adfabff89e447340aa2d04a8cfa57024.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_adfabff89e447340aa2d04a8cfa57024.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_405434009cf7ee43c8bfbdff08e4250d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_405434009cf7ee43c8bfbdff08e4250d.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_79daacfb88223295f07f5226b5fe0f93.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_79daacfb88223295f07f5226b5fe0f93.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_414ffae9801ead85a5bfcc84f66a5991.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_414ffae9801ead85a5bfcc84f66a5991.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_69ee26f766c1e5b484fb4bf3b21716a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_69ee26f766c1e5b484fb4bf3b21716a4.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_fddc8d758420f42f5aec7ac4660e4e09.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_fddc8d758420f42f5aec7ac4660e4e09.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F90%252F5290b6f42942ca57db0a1daddd240374%252Fpa%252FRU40839_88b3091ebd8a5435dae4c4e6c9946f0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_88b3091ebd8a5435dae4c4e6c9946f0d.jpg already downloaded
2026-03-28 10:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea, identifier: RU40839
2026-03-28 10:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839
2026-03-28 10:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839
2026-03-28 10:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ab06a83-ca1b-5684-abdd-5a53f38de1ea with identifier: RU40839 to the API
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RU40839>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 349,
 'expiration_date': '2026-03-30T15:16:19Z',
 'fuel_type': 'diesel',
 'id': '4ab06a83-ca1b-5684-abdd-5a53f38de1ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU40839',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 127133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_3f8ae8daf22023c82286ffa3cf7aaa5b.jpg',
                'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_312af361c9a066a6a0ee9015f8db6aed.jpg',
                'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_39a2b710dcd617cb0925578f30301f1c.jpg',
                'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_adfabff89e447340aa2d04a8cfa57024.jpg',
                'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_405434009cf7ee43c8bfbdff08e4250d.jpg',
                'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_79daacfb88223295f07f5226b5fe0f93.jpg',
                'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_414ffae9801ead85a5bfcc84f66a5991.jpg',
                'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_69ee26f766c1e5b484fb4bf3b21716a4.jpg',
                'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_fddc8d758420f42f5aec7ac4660e4e09.jpg',
                'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_88b3091ebd8a5435dae4c4e6c9946f0d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2676655,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_3f8ae8daf22023c82286ffa3cf7aaa5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2292547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_312af361c9a066a6a0ee9015f8db6aed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_39a2b710dcd617cb0925578f30301f1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2489841,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_adfabff89e447340aa2d04a8cfa57024.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2445766,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_405434009cf7ee43c8bfbdff08e4250d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_79daacfb88223295f07f5226b5fe0f93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380674,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_414ffae9801ead85a5bfcc84f66a5991.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2588365,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_69ee26f766c1e5b484fb4bf3b21716a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_fddc8d758420f42f5aec7ac4660e4e09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ab06a83-ca1b-5684-abdd-5a53f38de1ea/4ab06a83-ca1b-5684-abdd-5a53f38de1ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2554986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/90/5290b6f42942ca57db0a1daddd240374/pa/RU40839_88b3091ebd8a5435dae4c4e6c9946f0d.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 Allroad 55 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40839%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [auto1.de] INFO: Saving data for RU40839: {'created_time': 1774694442.747279, 'last_price_update_time': 1774694442.747293, 'auction_closing_time': 1774883779.0}
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU40839') HTTP/1.1" 204 0
2026-03-28 10:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_46eb6461906aa4221a1aac6675e6f087.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300
2026-03-28 10:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with scrape type 1
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_2b3ea35d4314ade25c3149eff3cc1444.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_2b3ea35d4314ade25c3149eff3cc1444.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_86a62869e12754d3651d00eb1764c429.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_86a62869e12754d3651d00eb1764c429.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_a1607fabfaf4347fb032ffa1e2ce8902.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_a1607fabfaf4347fb032ffa1e2ce8902.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_4db44ce6827ba2c34571af372eeee10f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_4db44ce6827ba2c34571af372eeee10f.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_7697e1801b2637dfef2a163868779ea1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_7697e1801b2637dfef2a163868779ea1.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_1fc32b53dce7cbfa5515517f7063ffc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_1fc32b53dce7cbfa5515517f7063ffc2.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_2105992a4797eff940ebe7ead07e896e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_2105992a4797eff940ebe7ead07e896e.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_0273684e82ab4cf084adf9b9efbd7533.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_0273684e82ab4cf084adf9b9efbd7533.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_b833f9674bfc01167feede78f1ea8bd2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_b833f9674bfc01167feede78f1ea8bd2.jpg already downloaded
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg18%252Fe6%252F18e6a03074021c6999e9e5fb57ef778a%252Fpa%252FTU93300_c486402974b1f3ae384d84644844c12f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_c486402974b1f3ae384d84644844c12f.jpg already downloaded
2026-03-28 10:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c, identifier: TU93300
2026-03-28 10:40:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb0110>
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_b6843632305acc048966ae5daf0f365e.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_b6843632305acc048966ae5daf0f365e.jpg saved to cache
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300
2026-03-28 10:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300
2026-03-28 10:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a5a9de1-918e-5c41-bdd8-bd2d96ca775c with identifier: TU93300 to the API
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TU93300>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:56:24Z',
 'fuel_type': 'diesel',
 'id': '6a5a9de1-918e-5c41-bdd8-bd2d96ca775c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU93300',
 'listing': 'auction',
 'location': 'DE, Rellingen',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 211818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_2b3ea35d4314ade25c3149eff3cc1444.jpg',
                'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_86a62869e12754d3651d00eb1764c429.jpg',
                'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_a1607fabfaf4347fb032ffa1e2ce8902.jpg',
                'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_4db44ce6827ba2c34571af372eeee10f.jpg',
                'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_7697e1801b2637dfef2a163868779ea1.jpg',
                'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_1fc32b53dce7cbfa5515517f7063ffc2.jpg',
                'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_2105992a4797eff940ebe7ead07e896e.jpg',
                'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_0273684e82ab4cf084adf9b9efbd7533.jpg',
                'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_b833f9674bfc01167feede78f1ea8bd2.jpg',
                'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_c486402974b1f3ae384d84644844c12f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2869515,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_2b3ea35d4314ade25c3149eff3cc1444.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835112,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_86a62869e12754d3651d00eb1764c429.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2768234,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_a1607fabfaf4347fb032ffa1e2ce8902.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2926195,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_4db44ce6827ba2c34571af372eeee10f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2761873,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_7697e1801b2637dfef2a163868779ea1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_1fc32b53dce7cbfa5515517f7063ffc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_2105992a4797eff940ebe7ead07e896e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_0273684e82ab4cf084adf9b9efbd7533.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_b833f9674bfc01167feede78f1ea8bd2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a5a9de1-918e-5c41-bdd8-bd2d96ca775c/6a5a9de1-918e-5c41-bdd8-bd2d96ca775c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2930401,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img18/e6/18e6a03074021c6999e9e5fb57ef778a/pa/TU93300_c486402974b1f3ae384d84644844c12f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2011}
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU93300%27 HTTP/1.1" 200 None
2026-03-28 10:40:43 [auto1.de] INFO: Saving data for TU93300: {'created_time': 1774694443.482385, 'last_price_update_time': 1774694443.482396, 'auction_closing_time': 1774886184.0}
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU93300') HTTP/1.1" 204 0
2026-03-28 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_3c0164ac1c11a1e03b00aa854fe4ab99.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc23750>
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_46eb6461906aa4221a1aac6675e6f087.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_46eb6461906aa4221a1aac6675e6f087.jpg saved to cache
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_0c60da5755296c81e4d7835090233db6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_e8473859a7f049c22bebaebc21ec345a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VY67413> (referer: https://www.auto1.com/v1/car-details-view/VY67413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfde510>
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_3c0164ac1c11a1e03b00aa854fe4ab99.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_3c0164ac1c11a1e03b00aa854fe4ab99.jpg saved to cache
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab891bc90>
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_0c60da5755296c81e4d7835090233db6.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_0c60da5755296c81e4d7835090233db6.jpg saved to cache
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdce50>
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_e8473859a7f049c22bebaebc21ec345a.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_e8473859a7f049c22bebaebc21ec345a.jpg saved to cache
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413
2026-03-28 10:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f320efa-a541-547e-86fd-10375c1cc8c1 with scrape type 1
2026-03-28 10:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_db0bd44562ca4bd2bfbd7ea4898386ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_db0bd44562ca4bd2bfbd7ea4898386ec.jpg not downloaded yet
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_9a81e07aae860ecd44e9652a6be77cee.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_6d5907a49c0efaca9572aff3a3f295fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_6d5907a49c0efaca9572aff3a3f295fa.jpg not downloaded yet
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_0802a89374e06e09a52f1242a5bfd9ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_0802a89374e06e09a52f1242a5bfd9ff.jpg not downloaded yet
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_0a32123851544b95b0db535c9a52945a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_0a32123851544b95b0db535c9a52945a.jpg not downloaded yet
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_9d447675c7631c4748b31bc6cb523b27.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_9d447675c7631c4748b31bc6cb523b27.jpg not downloaded yet
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_ac5b4e86b701f9edaf4341bf6eb9ff30.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_ac5b4e86b701f9edaf4341bf6eb9ff30.jpg not downloaded yet
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_6d5907a49c0efaca9572aff3a3f295fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_ac6f44096ceb719317baf9ea2187d7bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_ac6f44096ceb719317baf9ea2187d7bf.jpg not downloaded yet
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_db0bd44562ca4bd2bfbd7ea4898386ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_db46113b3f559f7dbd4cd0b4f50951e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_db46113b3f559f7dbd4cd0b4f50951e2.jpg not downloaded yet
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_23cdb83cadea593fdf559d2f0dec6a77.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_23cdb83cadea593fdf559d2f0dec6a77.jpg not downloaded yet
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba79e550>
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_9a81e07aae860ecd44e9652a6be77cee.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_9a81e07aae860ecd44e9652a6be77cee.jpg saved to cache
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_9b5f9196da9bf5f8b18182ad38d64b52.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_9b5f9196da9bf5f8b18182ad38d64b52.jpg not downloaded yet
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb1910>
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_6d5907a49c0efaca9572aff3a3f295fa.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_6d5907a49c0efaca9572aff3a3f295fa.jpg saved to cache
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU93693> (referer: https://www.auto1.com/v1/car-details-view/DU93693/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdf2490>
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_db0bd44562ca4bd2bfbd7ea4898386ec.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_db0bd44562ca4bd2bfbd7ea4898386ec.jpg saved to cache
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_0802a89374e06e09a52f1242a5bfd9ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_9d447675c7631c4748b31bc6cb523b27.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_79828dd5a016a333ce534efd8538b49c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_23cdb83cadea593fdf559d2f0dec6a77.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_ac6f44096ceb719317baf9ea2187d7bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_9b5f9196da9bf5f8b18182ad38d64b52.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693
2026-03-28 10:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with scrape type 1
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_31f3f77416dbb16fcfdc96c7363642a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_31f3f77416dbb16fcfdc96c7363642a8.jpg not downloaded yet
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_29c4520fbe56d15265387b3f8d6ab236.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_29c4520fbe56d15265387b3f8d6ab236.jpg not downloaded yet
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_bddb695bf4b1eb5f20ce0087c06d08dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_bddb695bf4b1eb5f20ce0087c06d08dc.jpg not downloaded yet
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_ab8de7aaaf7b2e33a7c4d2e22de4cf45.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_ab8de7aaaf7b2e33a7c4d2e22de4cf45.jpg not downloaded yet
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ad810>
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_0802a89374e06e09a52f1242a5bfd9ff.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_0802a89374e06e09a52f1242a5bfd9ff.jpg saved to cache
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe82fd0>
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_9d447675c7631c4748b31bc6cb523b27.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_9d447675c7631c4748b31bc6cb523b27.jpg saved to cache
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfe9c50>
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf6%252F93%252Ff6938032c76b7b0d149da6873c93dcd1%252Fpa%252FZV63958_79828dd5a016a333ce534efd8538b49c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_79828dd5a016a333ce534efd8538b49c.jpg saved to cache
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dab3ec60-1e85-5c08-be19-0ac6f7c02853
2026-03-28 10:40:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dab3ec60-1e85-5c08-be19-0ac6f7c02853, skipping ID generation
2026-03-28 10:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab3ec60-1e85-5c08-be19-0ac6f7c02853 with scrape type 1
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dab3ec60-1e85-5c08-be19-0ac6f7c02853 sending to next pipeline
2026-03-28 10:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dab3ec60-1e85-5c08-be19-0ac6f7c02853, identifier: ZV63958
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_a4cf56f78e429eb84418a5f2b3294faf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_a4cf56f78e429eb84418a5f2b3294faf.jpg not downloaded yet
2026-03-28 10:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958
2026-03-28 10:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958
2026-03-28 10:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dab3ec60-1e85-5c08-be19-0ac6f7c02853 with identifier: ZV63958 to the API
2026-03-28 10:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_79828dd5a016a333ce534efd8538b49c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:28Z',
 'fuel_type': 'petrol',
 'id': 'dab3ec60-1e85-5c08-be19-0ac6f7c02853',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV63958',
 'listing': 'auction',
 'location': 'DE, Trier',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 232902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3173073,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_c4bd06b4c1cb19431207e3e38b21bafe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_9a81e07aae860ecd44e9652a6be77cee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908020,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_79828dd5a016a333ce534efd8538b49c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_3c0164ac1c11a1e03b00aa854fe4ab99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57486,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_46eb6461906aa4221a1aac6675e6f087.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2884105,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_e8473859a7f049c22bebaebc21ec345a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3001980,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_0c60da5755296c81e4d7835090233db6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_b6843632305acc048966ae5daf0f365e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_178e4d6026569b0f3cf82f7089bfd52a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dab3ec60-1e85-5c08-be19-0ac6f7c02853/dab3ec60-1e85-5c08-be19-0ac6f7c02853_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3216676,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf6/93/f6938032c76b7b0d149da6873c93dcd1/pa/ZV63958_9e81feb16d0eaa93cd039384f91eb49a.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Ultimate Start/Stop',
 'transmission': 'automatic',
 'trim': 'Ultimate Start/Stop',
 'year': 2019}
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV63958%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [auto1.de] INFO: Saving data for ZV63958: {'created_time': 1774694445.189796, 'last_price_update_time': 1774694445.189806, 'auction_closing_time': 1774885048.0}
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV63958') HTTP/1.1" 204 0
2026-03-28 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_ac5b4e86b701f9edaf4341bf6eb9ff30.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_0a32123851544b95b0db535c9a52945a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_6f64b1e6668a6d714f70d2fe6a948981.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_6f64b1e6668a6d714f70d2fe6a948981.jpg not downloaded yet
2026-03-28 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK80695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_b6ac3ef47b6348209199b380eb9cb617.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_b6ac3ef47b6348209199b380eb9cb617.jpg not downloaded yet
2026-03-28 10:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf33a90>
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_23cdb83cadea593fdf559d2f0dec6a77.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_23cdb83cadea593fdf559d2f0dec6a77.jpg saved to cache
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88e4550>
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_ac6f44096ceb719317baf9ea2187d7bf.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_ac6f44096ceb719317baf9ea2187d7bf.jpg saved to cache
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdf30d0>
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_9b5f9196da9bf5f8b18182ad38d64b52.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_9b5f9196da9bf5f8b18182ad38d64b52.jpg saved to cache
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_f0fa3c709cf660988d9777e9a1c13112.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_f0fa3c709cf660988d9777e9a1c13112.jpg not downloaded yet
2026-03-28 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM10522> (referer: https://www.auto1.com/v1/car-details-view/LM10522/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DS20438> (referer: https://www.auto1.com/v1/car-details-view/DS20438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8892b90>
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_ac5b4e86b701f9edaf4341bf6eb9ff30.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_ac5b4e86b701f9edaf4341bf6eb9ff30.jpg saved to cache
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc1090>
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_0a32123851544b95b0db535c9a52945a.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_0a32123851544b95b0db535c9a52945a.jpg saved to cache
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_665fe7b7872467a18a00d8219fcfff66.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_665fe7b7872467a18a00d8219fcfff66.jpg not downloaded yet
2026-03-28 10:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_352cdd83dc185b1def3a9e39153a96fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_352cdd83dc185b1def3a9e39153a96fb.jpg not downloaded yet
2026-03-28 10:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522
2026-03-28 10:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with scrape type 1
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_4f38b6e45977a27c87ea2ed11d69bf69.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4f38b6e45977a27c87ea2ed11d69bf69.jpg not downloaded yet
2026-03-28 10:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438
2026-03-28 10:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with scrape type 1
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0fb7c6e4-e8ba-5bef-9bce-e52199708f93
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_50d4cc231ab5ef2fac67bfba6849f299.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_50d4cc231ab5ef2fac67bfba6849f299.jpg already downloaded
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_f14c850b1d4df69020472414298aebeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_f14c850b1d4df69020472414298aebeb.jpg already downloaded
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_980e1511248c07bc6d5c893ad78badd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_980e1511248c07bc6d5c893ad78badd6.jpg already downloaded
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_5a5959d445ef9764a429ad73954ef4ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_5a5959d445ef9764a429ad73954ef4ad.jpg already downloaded
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_4acffb27f8671e972ba7a6e9f8bfdac5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_4acffb27f8671e972ba7a6e9f8bfdac5.jpg already downloaded
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_9d7c038adff4369cc0b764c73b2ad8d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_9d7c038adff4369cc0b764c73b2ad8d9.jpg already downloaded
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_ca59a14e524f3c7bb6fbd43e8f812723.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_ca59a14e524f3c7bb6fbd43e8f812723.jpg already downloaded
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_52d11e2ff7502dc153f053dceb16bddd.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_52d11e2ff7502dc153f053dceb16bddd.jpg already downloaded
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_6c9a61e2c67325bc8bb0a3224a45e2bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_6c9a61e2c67325bc8bb0a3224a45e2bf.jpg already downloaded
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252Fb2%252Fadb205a9ab3b469960495502a11707c2%252Fpa%252FDS20438_c6327f5d613eabe7a3e90b03e4a74646.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_c6327f5d613eabe7a3e90b03e4a74646.jpg already downloaded
2026-03-28 10:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93, identifier: DS20438
2026-03-28 10:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438
2026-03-28 10:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438
2026-03-28 10:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fb7c6e4-e8ba-5bef-9bce-e52199708f93 with identifier: DS20438 to the API
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DS20438>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:38:21Z',
 'fuel_type': 'diesel',
 'id': '0fb7c6e4-e8ba-5bef-9bce-e52199708f93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS20438',
 'listing': 'auction',
 'location': 'DE, Reinbek',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 109205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_50d4cc231ab5ef2fac67bfba6849f299.jpg',
                'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_f14c850b1d4df69020472414298aebeb.jpg',
                'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_980e1511248c07bc6d5c893ad78badd6.jpg',
                'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_5a5959d445ef9764a429ad73954ef4ad.jpg',
                'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_4acffb27f8671e972ba7a6e9f8bfdac5.jpg',
                'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_9d7c038adff4369cc0b764c73b2ad8d9.jpg',
                'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_ca59a14e524f3c7bb6fbd43e8f812723.jpg',
                'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_52d11e2ff7502dc153f053dceb16bddd.jpg',
                'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_6c9a61e2c67325bc8bb0a3224a45e2bf.jpg',
                'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_c6327f5d613eabe7a3e90b03e4a74646.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2853083,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_50d4cc231ab5ef2fac67bfba6849f299.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_f14c850b1d4df69020472414298aebeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2913882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_980e1511248c07bc6d5c893ad78badd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_5a5959d445ef9764a429ad73954ef4ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2917154,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_4acffb27f8671e972ba7a6e9f8bfdac5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_9d7c038adff4369cc0b764c73b2ad8d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2996124,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_ca59a14e524f3c7bb6fbd43e8f812723.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_52d11e2ff7502dc153f053dceb16bddd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2802716,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_6c9a61e2c67325bc8bb0a3224a45e2bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fb7c6e4-e8ba-5bef-9bce-e52199708f93/0fb7c6e4-e8ba-5bef-9bce-e52199708f93_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2784347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/b2/adb205a9ab3b469960495502a11707c2/pa/DS20438_c6327f5d613eabe7a3e90b03e4a74646.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS20438%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Saving data for DS20438: {'created_time': 1774694446.294124, 'last_price_update_time': 1774694446.294134, 'auction_closing_time': 1774885101.0}
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS20438') HTTP/1.1" 204 0
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_1fae1e85a1742dbffbf579eeb9fadb4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_1fae1e85a1742dbffbf579eeb9fadb4e.jpg not downloaded yet
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_f0fa3c709cf660988d9777e9a1c13112.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_6f64b1e6668a6d714f70d2fe6a948981.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_b6ac3ef47b6348209199b380eb9cb617.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_707aeeca247fcdad107d1f91ffb4c977.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_707aeeca247fcdad107d1f91ffb4c977.jpg not downloaded yet
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ98908> (referer: https://www.auto1.com/v1/car-details-view/VZ98908/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_6588309f4f765cb563b504ebc5a11cd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_6588309f4f765cb563b504ebc5a11cd6.jpg not downloaded yet
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_c0bddbc3d0e59055e3cecf446193bfde.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_c0bddbc3d0e59055e3cecf446193bfde.jpg not downloaded yet
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_8b2c0afdb015fbce2af00577446d8e6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_8b2c0afdb015fbce2af00577446d8e6c.jpg not downloaded yet
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_db46113b3f559f7dbd4cd0b4f50951e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_665fe7b7872467a18a00d8219fcfff66.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_4eb1676c430803f6e492dd36acad1d5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4eb1676c430803f6e492dd36acad1d5f.jpg not downloaded yet
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4f38b6e45977a27c87ea2ed11d69bf69.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_352cdd83dc185b1def3a9e39153a96fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_4a36b5ae2c3290ebea3b73d1b56d4e66.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4a36b5ae2c3290ebea3b73d1b56d4e66.jpg not downloaded yet
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_869cb5f05f7feaed24d989263e0be961.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_869cb5f05f7feaed24d989263e0be961.jpg not downloaded yet
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb3c90>
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_f0fa3c709cf660988d9777e9a1c13112.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_f0fa3c709cf660988d9777e9a1c13112.jpg saved to cache
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf333d0>
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_6f64b1e6668a6d714f70d2fe6a948981.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_6f64b1e6668a6d714f70d2fe6a948981.jpg saved to cache
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdf3290>
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_b6ac3ef47b6348209199b380eb9cb617.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_b6ac3ef47b6348209199b380eb9cb617.jpg saved to cache
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_ed310f49290c5060335d1dbe5fec509c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_ed310f49290c5060335d1dbe5fec509c.jpg not downloaded yet
2026-03-28 10:40:46 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 9642 | hits on page: 40
2026-03-28 10:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908
2026-03-28 10:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af3c8a47-bd80-5dc3-936a-a72e276603f1 with scrape type 1
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_6256fe6984be8c3ad14a62e764a72f85.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_6256fe6984be8c3ad14a62e764a72f85.jpg not downloaded yet
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE30814%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for WE30814: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for CV42130: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for TV20692: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA77246%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for EA77246: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL38868%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for KL38868: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU72162%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for PU72162: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15904%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for SD15904: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: PC15308
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC15308%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for PC15308: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME09470%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for ME09470: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ09616%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for HJ09616: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP73203%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for CP73203: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: MS28207
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS28207%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for MS28207: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND29954%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for ND29954: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: XL55918
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: NV14001
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: DB45591
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: LG34778
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: GP45191
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: CB43306
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB43306%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for CB43306: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: AA51381
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: JL74315
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: UF03548
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14307%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for ZU14307: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN04984%27 HTTP/1.1" 200 None
2026-03-28 10:40:46 [auto1.de] INFO: Scrape type for TN04984: 0
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: XL09941
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: GR29564
2026-03-28 10:40:46 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43120%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for ZK43120: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ43118%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for GZ43118: 0
2026-03-28 10:40:47 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Scrape type for CX18884: 0
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_314edf4707f2516ca321b3e4f3c3974c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_314edf4707f2516ca321b3e4f3c3974c.jpg not downloaded yet
2026-03-28 10:40:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdb3110>
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F01%252Fef014104d8f27aac533827cc61f2d5e6%252Fpa%252FVY67413_db46113b3f559f7dbd4cd0b4f50951e2.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_db46113b3f559f7dbd4cd0b4f50951e2.jpg saved to cache
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f320efa-a541-547e-86fd-10375c1cc8c1
2026-03-28 10:40:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f320efa-a541-547e-86fd-10375c1cc8c1, skipping ID generation
2026-03-28 10:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f320efa-a541-547e-86fd-10375c1cc8c1 with scrape type 1
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f320efa-a541-547e-86fd-10375c1cc8c1 sending to next pipeline
2026-03-28 10:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f320efa-a541-547e-86fd-10375c1cc8c1, identifier: VY67413
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe06e50>
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_665fe7b7872467a18a00d8219fcfff66.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_665fe7b7872467a18a00d8219fcfff66.jpg saved to cache
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf8f150>
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_4f38b6e45977a27c87ea2ed11d69bf69.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4f38b6e45977a27c87ea2ed11d69bf69.jpg saved to cache
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda4d10>
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_352cdd83dc185b1def3a9e39153a96fb.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_352cdd83dc185b1def3a9e39153a96fb.jpg saved to cache
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_6588309f4f765cb563b504ebc5a11cd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_c0bddbc3d0e59055e3cecf446193bfde.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_8b2c0afdb015fbce2af00577446d8e6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_5041a9b1125be3dea3928a1483eeb31d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_5041a9b1125be3dea3928a1483eeb31d.jpg not downloaded yet
2026-03-28 10:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413
2026-03-28 10:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413
2026-03-28 10:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f320efa-a541-547e-86fd-10375c1cc8c1 with identifier: VY67413 to the API
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_db46113b3f559f7dbd4cd0b4f50951e2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:31Z',
 'fuel_type': 'petrol',
 'id': '7f320efa-a541-547e-86fd-10375c1cc8c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY67413',
 'listing': 'auction',
 'location': 'DE, Geldern',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 98170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_db0bd44562ca4bd2bfbd7ea4898386ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_6d5907a49c0efaca9572aff3a3f295fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_0802a89374e06e09a52f1242a5bfd9ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_0a32123851544b95b0db535c9a52945a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_9d447675c7631c4748b31bc6cb523b27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_ac5b4e86b701f9edaf4341bf6eb9ff30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410227,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_ac6f44096ceb719317baf9ea2187d7bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2403316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_db46113b3f559f7dbd4cd0b4f50951e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_23cdb83cadea593fdf559d2f0dec6a77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f320efa-a541-547e-86fd-10375c1cc8c1/7f320efa-a541-547e-86fd-10375c1cc8c1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/01/ef014104d8f27aac533827cc61f2d5e6/pa/VY67413_9b5f9196da9bf5f8b18182ad38d64b52.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Smart forfour 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2015}
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67413%27 HTTP/1.1" 200 None
2026-03-28 10:40:47 [auto1.de] INFO: Saving data for VY67413: {'created_time': 1774694447.967768, 'last_price_update_time': 1774694447.967782, 'auction_closing_time': 1774884691.0}
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY67413') HTTP/1.1" 204 0
2026-03-28 10:40:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_186dba72c1567e1028daf4804e21844f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_186dba72c1567e1028daf4804e21844f.jpg not downloaded yet
2026-03-28 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PX49171> (referer: https://www.auto1.com/v1/car-details-view/PX49171/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_fb9fc04b5bf37f24067eeaef0790ffcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_fb9fc04b5bf37f24067eeaef0790ffcc.jpg not downloaded yet
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba7e4510>
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_6588309f4f765cb563b504ebc5a11cd6.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_6588309f4f765cb563b504ebc5a11cd6.jpg saved to cache
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd924d0>
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_c0bddbc3d0e59055e3cecf446193bfde.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_c0bddbc3d0e59055e3cecf446193bfde.jpg saved to cache
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc230d0>
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_8b2c0afdb015fbce2af00577446d8e6c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_8b2c0afdb015fbce2af00577446d8e6c.jpg saved to cache
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_314edf4707f2516ca321b3e4f3c3974c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_9d32c20e10ad96ee6f59375045e7469b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_9d32c20e10ad96ee6f59375045e7469b.jpg not downloaded yet
2026-03-28 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_6256fe6984be8c3ad14a62e764a72f85.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_b287012ab7c48730801dde5477b41f6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_b287012ab7c48730801dde5477b41f6a.jpg not downloaded yet
2026-03-28 10:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171
2026-03-28 10:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51fc7b6-e869-525e-a098-dfc99aa20e17 with scrape type 1
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b51fc7b6-e869-525e-a098-dfc99aa20e17
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_aabccbb7feef7b59d24499c3bc7c4e2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_aabccbb7feef7b59d24499c3bc7c4e2b.jpg already downloaded
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_fa80768e37f0480b3ad4d230758ac2a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_fa80768e37f0480b3ad4d230758ac2a0.jpg already downloaded
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_724758d908a50e8e8a1568ad965be5de.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_724758d908a50e8e8a1568ad965be5de.jpg already downloaded
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_6677ccb43ca2d973bbb3768c690478ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_6677ccb43ca2d973bbb3768c690478ed.jpg already downloaded
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_5980c9ddc23cdaf4a2c2a9e22a35b71e.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_5980c9ddc23cdaf4a2c2a9e22a35b71e.jpg already downloaded
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_5017ba4d35c181a5c27e8ce1bf059bc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_5017ba4d35c181a5c27e8ce1bf059bc6.jpg already downloaded
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_6f82ff390426ad7dab780887265443b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_6f82ff390426ad7dab780887265443b1.jpg already downloaded
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_fc32686bafb48680d30da55d12efe488.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_fc32686bafb48680d30da55d12efe488.jpg already downloaded
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_1b295c183d290e752741d451f504dc2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_1b295c183d290e752741d451f504dc2a.jpg already downloaded
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg83%252F12%252F831217580c4b68f9de1816d86518204f%252Fpa%252FPX49171_cf126329bb9dffa1f58ea87bd1cb2700.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_cf126329bb9dffa1f58ea87bd1cb2700.jpg already downloaded
2026-03-28 10:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b51fc7b6-e869-525e-a098-dfc99aa20e17, identifier: PX49171
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_2bce54db6427b35426a0e5048c669035.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_2bce54db6427b35426a0e5048c669035.jpg not downloaded yet
2026-03-28 10:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171
2026-03-28 10:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171
2026-03-28 10:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b51fc7b6-e869-525e-a098-dfc99aa20e17 with identifier: PX49171 to the API
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PX49171>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:45:51Z',
 'fuel_type': 'diesel',
 'id': 'b51fc7b6-e869-525e-a098-dfc99aa20e17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX49171',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 244825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_aabccbb7feef7b59d24499c3bc7c4e2b.jpg',
                'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_fa80768e37f0480b3ad4d230758ac2a0.jpg',
                'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_724758d908a50e8e8a1568ad965be5de.jpg',
                'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_6677ccb43ca2d973bbb3768c690478ed.jpg',
                'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_5980c9ddc23cdaf4a2c2a9e22a35b71e.jpg',
                'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_5017ba4d35c181a5c27e8ce1bf059bc6.jpg',
                'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_6f82ff390426ad7dab780887265443b1.jpg',
                'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_fc32686bafb48680d30da55d12efe488.jpg',
                'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_1b295c183d290e752741d451f504dc2a.jpg',
                'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_cf126329bb9dffa1f58ea87bd1cb2700.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_aabccbb7feef7b59d24499c3bc7c4e2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_fa80768e37f0480b3ad4d230758ac2a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2865633,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_724758d908a50e8e8a1568ad965be5de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2823323,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_6677ccb43ca2d973bbb3768c690478ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2930296,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_5980c9ddc23cdaf4a2c2a9e22a35b71e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_5017ba4d35c181a5c27e8ce1bf059bc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2169307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_6f82ff390426ad7dab780887265443b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_fc32686bafb48680d30da55d12efe488.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76236,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_1b295c183d290e752741d451f504dc2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b51fc7b6-e869-525e-a098-dfc99aa20e17/b51fc7b6-e869-525e-a098-dfc99aa20e17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3177727,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img83/12/831217580c4b68f9de1816d86518204f/pa/PX49171_cf126329bb9dffa1f58ea87bd1cb2700.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX49171%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [auto1.de] INFO: Saving data for PX49171: {'created_time': 1774694448.945573, 'last_price_update_time': 1774694448.945585, 'auction_closing_time': 1774885551.0}
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX49171') HTTP/1.1" 204 0
2026-03-28 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_707aeeca247fcdad107d1f91ffb4c977.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_186dba72c1567e1028daf4804e21844f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_fb9fc04b5bf37f24067eeaef0790ffcc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_1be27ede88a954c2225f3a5a49170aa7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_1be27ede88a954c2225f3a5a49170aa7.jpg not downloaded yet
2026-03-28 10:40:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK80695> (referer: https://www.auto1.com/v1/car-details-view/SK80695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_f11f8abfe8f002243d9f3dab8601ab4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_f11f8abfe8f002243d9f3dab8601ab4d.jpg not downloaded yet
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf8bd10>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_314edf4707f2516ca321b3e4f3c3974c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_314edf4707f2516ca321b3e4f3c3974c.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc23310>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_6256fe6984be8c3ad14a62e764a72f85.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_6256fe6984be8c3ad14a62e764a72f85.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_5041a9b1125be3dea3928a1483eeb31d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_b287012ab7c48730801dde5477b41f6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_9d32c20e10ad96ee6f59375045e7469b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_ab8de7aaaf7b2e33a7c4d2e22de4cf45.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd444d0>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_707aeeca247fcdad107d1f91ffb4c977.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_707aeeca247fcdad107d1f91ffb4c977.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf73610>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_186dba72c1567e1028daf4804e21844f.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_186dba72c1567e1028daf4804e21844f.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89ce750>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_fb9fc04b5bf37f24067eeaef0790ffcc.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_fb9fc04b5bf37f24067eeaef0790ffcc.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695
2026-03-28 10:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with scrape type 1
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_65a61338c14745132d1943d314105661.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_65a61338c14745132d1943d314105661.jpg not downloaded yet
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_29c4520fbe56d15265387b3f8d6ab236.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_bddb695bf4b1eb5f20ce0087c06d08dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_a4cf56f78e429eb84418a5f2b3294faf.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_13550c879af6c23c8d51018d180a5926.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_13550c879af6c23c8d51018d180a5926.jpg not downloaded yet
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_2bce54db6427b35426a0e5048c669035.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_f11f8abfe8f002243d9f3dab8601ab4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_1be27ede88a954c2225f3a5a49170aa7.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW55074/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_5d4ed7c8ce3808b843a2e55ab97e27ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_5d4ed7c8ce3808b843a2e55ab97e27ec.jpg not downloaded yet
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3abaaa8b90>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_5041a9b1125be3dea3928a1483eeb31d.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_5041a9b1125be3dea3928a1483eeb31d.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe437d0>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_b287012ab7c48730801dde5477b41f6a.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_b287012ab7c48730801dde5477b41f6a.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aba81d090>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_9d32c20e10ad96ee6f59375045e7469b.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_9d32c20e10ad96ee6f59375045e7469b.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabdf0d50>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_ab8de7aaaf7b2e33a7c4d2e22de4cf45.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_ab8de7aaaf7b2e33a7c4d2e22de4cf45.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_5a2e5b1da918bd640ef1ba655833bfcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_5a2e5b1da918bd640ef1ba655833bfcc.jpg not downloaded yet
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_b103b3252424c87789c5059ffeffbb80.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_b103b3252424c87789c5059ffeffbb80.jpg not downloaded yet
2026-03-28 10:40:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe41b10>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_29c4520fbe56d15265387b3f8d6ab236.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_29c4520fbe56d15265387b3f8d6ab236.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab8a1b1d0>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_bddb695bf4b1eb5f20ce0087c06d08dc.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_bddb695bf4b1eb5f20ce0087c06d08dc.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf74a50>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_a4cf56f78e429eb84418a5f2b3294faf.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_a4cf56f78e429eb84418a5f2b3294faf.jpg saved to cache
2026-03-28 10:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabff8550>
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_2bce54db6427b35426a0e5048c669035.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_2bce54db6427b35426a0e5048c669035.jpg saved to cache
2026-03-28 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc51510>
2026-03-28 10:40:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_f11f8abfe8f002243d9f3dab8601ab4d.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_f11f8abfe8f002243d9f3dab8601ab4d.jpg saved to cache
2026-03-28 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfe0a90>
2026-03-28 10:40:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfc%252F4f%252Ffc4f52671e1966adc2906eee7b13b843%252Fpa%252FVZ98908_1be27ede88a954c2225f3a5a49170aa7.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_1be27ede88a954c2225f3a5a49170aa7.jpg saved to cache
2026-03-28 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af3c8a47-bd80-5dc3-936a-a72e276603f1
2026-03-28 10:40:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af3c8a47-bd80-5dc3-936a-a72e276603f1, skipping ID generation
2026-03-28 10:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af3c8a47-bd80-5dc3-936a-a72e276603f1 with scrape type 1
2026-03-28 10:40:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af3c8a47-bd80-5dc3-936a-a72e276603f1 sending to next pipeline
2026-03-28 10:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af3c8a47-bd80-5dc3-936a-a72e276603f1, identifier: VZ98908
2026-03-28 10:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908
2026-03-28 10:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908
2026-03-28 10:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af3c8a47-bd80-5dc3-936a-a72e276603f1 with identifier: VZ98908 to the API
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_1be27ede88a954c2225f3a5a49170aa7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:30:01Z',
 'fuel_type': 'petrol',
 'id': 'af3c8a47-bd80-5dc3-936a-a72e276603f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ98908',
 'listing': 'auction',
 'location': 'DE, Esslingen am Neckar',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 175842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_6256fe6984be8c3ad14a62e764a72f85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_314edf4707f2516ca321b3e4f3c3974c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_5041a9b1125be3dea3928a1483eeb31d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_186dba72c1567e1028daf4804e21844f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_fb9fc04b5bf37f24067eeaef0790ffcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_9d32c20e10ad96ee6f59375045e7469b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_b287012ab7c48730801dde5477b41f6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_2bce54db6427b35426a0e5048c669035.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_1be27ede88a954c2225f3a5a49170aa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af3c8a47-bd80-5dc3-936a-a72e276603f1/af3c8a47-bd80-5dc3-936a-a72e276603f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfc/4f/fc4f52671e1966adc2906eee7b13b843/pa/VZ98908_f11f8abfe8f002243d9f3dab8601ab4d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Saving data for VZ98908: {'created_time': 1774694450.682133, 'last_price_update_time': 1774694450.682145, 'auction_closing_time': 1774884601.0}
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ98908') HTTP/1.1" 204 0
2026-03-28 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG96250> (referer: https://www.auto1.com/v1/car-details-view/LG96250/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_1fae1e85a1742dbffbf579eeb9fadb4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_869cb5f05f7feaed24d989263e0be961.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4a36b5ae2c3290ebea3b73d1b56d4e66.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_ed310f49290c5060335d1dbe5fec509c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_65a61338c14745132d1943d314105661.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_b103b3252424c87789c5059ffeffbb80.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:50 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 9643 | hits on page: 40
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Scrape type for CX18884: 0
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: PG01901
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA32054%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Scrape type for NA32054: 0
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: XB18292
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB18292%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Scrape type for XB18292: 0
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: XB21556
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: VH56486
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ14237%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Scrape type for DJ14237: 0
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV68047%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Scrape type for EV68047: 0
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Scrape type for CF39305: 0
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: YL20431
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB13775%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Scrape type for DB13775: 0
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK49641%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Scrape type for UK49641: 0
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD93241%27 HTTP/1.1" 200 None
2026-03-28 10:40:50 [auto1.de] INFO: Scrape type for HD93241: 0
2026-03-28 10:40:50 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-28 10:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54532%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [auto1.de] INFO: Scrape type for JP54532: 0
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: NW08152
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW08152%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [auto1.de] INFO: Scrape type for NW08152: 2
2026-03-28 10:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d4e94c-ce01-5d2e-a2f5-b10f868bb489 with identifier: NW08152
2026-03-28 10:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84d4e94c-ce01-5d2e-a2f5-b10f868bb489 with scrape type 2
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84d4e94c-ce01-5d2e-a2f5-b10f868bb489 with scrape type 2
2026-03-28 10:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84d4e94c-ce01-5d2e-a2f5-b10f868bb489, identifier: NW08152
2026-03-28 10:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84d4e94c-ce01-5d2e-a2f5-b10f868bb489 with identifier: NW08152
2026-03-28 10:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84d4e94c-ce01-5d2e-a2f5-b10f868bb489 with identifier: NW08152
2026-03-28 10:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84d4e94c-ce01-5d2e-a2f5-b10f868bb489 with identifier: NW08152 to the API
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:17:37Z',
 'fuel_type': 'diesel',
 'id': '84d4e94c-ce01-5d2e-a2f5-b10f868bb489',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW08152',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 270985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-08',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Cool&Connect',
 'transmission': 'automatic',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW08152%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [auto1.de] INFO: Saving data for NW08152: {'auction_closing_time': 1774714657.0, 'created_time': 1774378140.203347, 'last_price_update_time': 1774694451.473669}
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW08152') HTTP/1.1" 204 0
2026-03-28 10:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250
2026-03-28 10:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with scrape type 1
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_bfbf822b0b31543880f9c1f7f5eb9477.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_bfbf822b0b31543880f9c1f7f5eb9477.jpg already downloaded
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_f62ff96769c423603bdd4e30d6154726.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_f62ff96769c423603bdd4e30d6154726.jpg already downloaded
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_6f4a82120aca6b7642385524a694d8f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_6f4a82120aca6b7642385524a694d8f9.jpg already downloaded
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_ffa858dd8a31afc42524c154bdac91a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_ffa858dd8a31afc42524c154bdac91a6.jpg already downloaded
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_83b4b9f0366df93385d42f9850e6666b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_83b4b9f0366df93385d42f9850e6666b.jpg already downloaded
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_9eaefd2cf99631bd30dc00f2c07f7854.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_9eaefd2cf99631bd30dc00f2c07f7854.jpg already downloaded
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_9245f619aa9b6dfcbe747b10af20d117.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_9245f619aa9b6dfcbe747b10af20d117.jpg already downloaded
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_66a96a67d0ffe46b020b0da333fbf3d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_66a96a67d0ffe46b020b0da333fbf3d3.jpg already downloaded
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_f71deb019c9b1e6bf8c990ae9f80289c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_f71deb019c9b1e6bf8c990ae9f80289c.jpg already downloaded
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252F5b%252Fea5bfbe02970787d13b06bac0485d878%252Fpa%252FLG96250_2179113f3ec3d97dc2751ec25eb64c75.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_2179113f3ec3d97dc2751ec25eb64c75.jpg already downloaded
2026-03-28 10:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0, identifier: LG96250
2026-03-28 10:40:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_5a2e5b1da918bd640ef1ba655833bfcc.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [auto1.de] INFO: Scrape type for CF85526: 0
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: TY55023
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36237%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [auto1.de] INFO: Scrape type for VU36237: 0
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [auto1.de] INFO: Scrape type for WE98596: 0
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: KR71178
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR71178%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [auto1.de] INFO: Scrape type for KR71178: 0
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: PK60768
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK60768%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [auto1.de] INFO: Scrape type for PK60768: 0
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: FK75470
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS55646%27 HTTP/1.1" 200 None
2026-03-28 10:40:51 [auto1.de] INFO: Scrape type for ZS55646: 0
2026-03-28 10:40:51 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-28 10:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT75774%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Scrape type for UT75774: 0
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28097%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Scrape type for WC28097: 0
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW71594%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Scrape type for XW71594: 0
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: ZA94755
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA94755%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Scrape type for ZA94755: 0
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Scrape type for BY91581: 0
2026-03-28 10:40:52 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-28 10:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250
2026-03-28 10:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250
2026-03-28 10:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0 with identifier: LG96250 to the API
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LG96250>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:54:03Z',
 'fuel_type': 'diesel',
 'id': '33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG96250',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Ford',
 'model': 'Transit Custom',
 'odometer': 41206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_bfbf822b0b31543880f9c1f7f5eb9477.jpg',
                'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_f62ff96769c423603bdd4e30d6154726.jpg',
                'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_6f4a82120aca6b7642385524a694d8f9.jpg',
                'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_ffa858dd8a31afc42524c154bdac91a6.jpg',
                'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_83b4b9f0366df93385d42f9850e6666b.jpg',
                'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_9eaefd2cf99631bd30dc00f2c07f7854.jpg',
                'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_9245f619aa9b6dfcbe747b10af20d117.jpg',
                'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_66a96a67d0ffe46b020b0da333fbf3d3.jpg',
                'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_f71deb019c9b1e6bf8c990ae9f80289c.jpg',
                'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_2179113f3ec3d97dc2751ec25eb64c75.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_bfbf822b0b31543880f9c1f7f5eb9477.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_f62ff96769c423603bdd4e30d6154726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_6f4a82120aca6b7642385524a694d8f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_ffa858dd8a31afc42524c154bdac91a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_83b4b9f0366df93385d42f9850e6666b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58163,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_9eaefd2cf99631bd30dc00f2c07f7854.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_9245f619aa9b6dfcbe747b10af20d117.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_66a96a67d0ffe46b020b0da333fbf3d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_f71deb019c9b1e6bf8c990ae9f80289c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0/33efe1aa-c125-5ff5-a7e7-a5dbc9f5f5c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/5b/ea5bfbe02970787d13b06bac0485d878/pa/LG96250_2179113f3ec3d97dc2751ec25eb64c75.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-04-06',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Ford Transit Custom 2.0 TDCi 320 L1 Trend',
 'transmission': 'manual',
 'trim': '320 L1 Trend',
 'year': 2020}
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96250%27 HTTP/1.1" 200 None
2026-03-28 10:40:52 [auto1.de] INFO: Saving data for LG96250: {'created_time': 1774694452.400891, 'last_price_update_time': 1774694452.4009, 'auction_closing_time': 1774886043.0}
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG96250') HTTP/1.1" 204 0
2026-03-28 10:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_13550c879af6c23c8d51018d180a5926.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_5d4ed7c8ce3808b843a2e55ab97e27ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd90e10>
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_1fae1e85a1742dbffbf579eeb9fadb4e.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_1fae1e85a1742dbffbf579eeb9fadb4e.jpg saved to cache
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabff7cd0>
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_869cb5f05f7feaed24d989263e0be961.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_869cb5f05f7feaed24d989263e0be961.jpg saved to cache
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8c3d0>
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_4a36b5ae2c3290ebea3b73d1b56d4e66.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4a36b5ae2c3290ebea3b73d1b56d4e66.jpg saved to cache
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabff4a10>
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_ed310f49290c5060335d1dbe5fec509c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_ed310f49290c5060335d1dbe5fec509c.jpg saved to cache
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd3b190>
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_65a61338c14745132d1943d314105661.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_65a61338c14745132d1943d314105661.jpg saved to cache
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe46c90>
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_b103b3252424c87789c5059ffeffbb80.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_b103b3252424c87789c5059ffeffbb80.jpg saved to cache
2026-03-28 10:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f6e50>
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_5a2e5b1da918bd640ef1ba655833bfcc.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_5a2e5b1da918bd640ef1ba655833bfcc.jpg saved to cache
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad
2026-03-28 10:40:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f7090>
2026-03-28 10:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_13550c879af6c23c8d51018d180a5926.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_13550c879af6c23c8d51018d180a5926.jpg saved to cache
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad
2026-03-28 10:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf88e90>
2026-03-28 10:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg42%252Fe6%252F42e694b544eda3054cbf91698cd080ff%252Fpa%252FSK80695_5d4ed7c8ce3808b843a2e55ab97e27ec.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_5d4ed7c8ce3808b843a2e55ab97e27ec.jpg saved to cache
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad
2026-03-28 10:40:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad, skipping ID generation
2026-03-28 10:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with scrape type 1
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad sending to next pipeline
2026-03-28 10:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad, identifier: SK80695
2026-03-28 10:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695
2026-03-28 10:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695
2026-03-28 10:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad with identifier: SK80695 to the API
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_5d4ed7c8ce3808b843a2e55ab97e27ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:07:19Z',
 'fuel_type': 'petrol',
 'id': '7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK80695',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 183607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_65a61338c14745132d1943d314105661.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_13550c879af6c23c8d51018d180a5926.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73228,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_5d4ed7c8ce3808b843a2e55ab97e27ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_5a2e5b1da918bd640ef1ba655833bfcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad/7df91d37-bb67-5d4e-ac0d-1d490b1ef7ad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img42/e6/42e694b544eda3054cbf91698cd080ff/pa/SK80695_b103b3252424c87789c5059ffeffbb80.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2006}
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [auto1.de] INFO: Saving data for SK80695: {'created_time': 1774694453.673618, 'last_price_update_time': 1774694453.673632, 'auction_closing_time': 1774883239.0}
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK80695') HTTP/1.1" 204 0
2026-03-28 10:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG50641> (referer: https://www.auto1.com/v1/car-details-view/NG50641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4eb1676c430803f6e492dd36acad1d5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW55074> (referer: https://www.auto1.com/v1/car-details-view/BW55074/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_31f3f77416dbb16fcfdc96c7363642a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641
2026-03-28 10:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with scrape type 1
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_45d946a5412101fc10e7776943d05bf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_45d946a5412101fc10e7776943d05bf3.jpg already downloaded
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_f6c7a8e442cee19164963be9e9da5e41.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_f6c7a8e442cee19164963be9e9da5e41.jpg already downloaded
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_f47cc554aaa34ffe1c2a42c2350218d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_f47cc554aaa34ffe1c2a42c2350218d7.jpg already downloaded
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_0cbc1dd6d963d43d79d8857768d32907.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_0cbc1dd6d963d43d79d8857768d32907.jpg already downloaded
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_4528132d3d080be6377dd8852ee1dba7.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_4528132d3d080be6377dd8852ee1dba7.jpg already downloaded
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_e7bbe52fb142e10ae5da35ff8e2b8d8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_e7bbe52fb142e10ae5da35ff8e2b8d8f.jpg already downloaded
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_cc45a40df508e10527c2ef56f1647bc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_cc45a40df508e10527c2ef56f1647bc2.jpg already downloaded
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_0d8e1bf39d87667f8c7bcba4e080ddca.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_0d8e1bf39d87667f8c7bcba4e080ddca.jpg already downloaded
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_af35342e78cb06ae1abccd022cafdf6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_af35342e78cb06ae1abccd022cafdf6d.jpg already downloaded
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fef%252F59ef12f7d10b73e24a74a870be295d36%252Fpa%252FNG50641_ac89c77e4a41732d7ee5a7048d8fbe37.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_ac89c77e4a41732d7ee5a7048d8fbe37.jpg already downloaded
2026-03-28 10:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7, identifier: NG50641
2026-03-28 10:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641
2026-03-28 10:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641
2026-03-28 10:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7 with identifier: NG50641 to the API
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG50641>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:57:08Z',
 'fuel_type': 'diesel',
 'id': 'c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG50641',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 238404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_45d946a5412101fc10e7776943d05bf3.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_f6c7a8e442cee19164963be9e9da5e41.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_f47cc554aaa34ffe1c2a42c2350218d7.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_0cbc1dd6d963d43d79d8857768d32907.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_4528132d3d080be6377dd8852ee1dba7.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_e7bbe52fb142e10ae5da35ff8e2b8d8f.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_cc45a40df508e10527c2ef56f1647bc2.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_0d8e1bf39d87667f8c7bcba4e080ddca.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_af35342e78cb06ae1abccd022cafdf6d.jpg',
                'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_ac89c77e4a41732d7ee5a7048d8fbe37.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_45d946a5412101fc10e7776943d05bf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_f6c7a8e442cee19164963be9e9da5e41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_f47cc554aaa34ffe1c2a42c2350218d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3129683,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_0cbc1dd6d963d43d79d8857768d32907.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_4528132d3d080be6377dd8852ee1dba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_e7bbe52fb142e10ae5da35ff8e2b8d8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3005926,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_cc45a40df508e10527c2ef56f1647bc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3176079,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_0d8e1bf39d87667f8c7bcba4e080ddca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_af35342e78cb06ae1abccd022cafdf6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7/c5f01b49-b8b1-51d7-8b6b-d62d5fa6c1b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/ef/59ef12f7d10b73e24a74a870be295d36/pa/NG50641_ac89c77e4a41732d7ee5a7048d8fbe37.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-11-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG50641%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [auto1.de] INFO: Saving data for NG50641: {'created_time': 1774694454.469318, 'last_price_update_time': 1774694454.469328, 'auction_closing_time': 1774886228.0}
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG50641') HTTP/1.1" 204 0
2026-03-28 10:40:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe51850>
2026-03-28 10:40:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F6f%252F756fdd7338d2fc1558468302a3955c99%252Fpa%252FLM10522_4eb1676c430803f6e492dd36acad1d5f.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4eb1676c430803f6e492dd36acad1d5f.jpg saved to cache
2026-03-28 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3
2026-03-28 10:40:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3, skipping ID generation
2026-03-28 10:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with scrape type 1
2026-03-28 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 sending to next pipeline
2026-03-28 10:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3, identifier: LM10522
2026-03-28 10:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074
2026-03-28 10:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24b8bbd-ae61-53d1-968a-013f8bc1496b with scrape type 1
2026-03-28 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c24b8bbd-ae61-53d1-968a-013f8bc1496b
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_a09faf359a004a667902e047bae88a55.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_a09faf359a004a667902e047bae88a55.jpg not downloaded yet
2026-03-28 10:40:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabe78490>
2026-03-28 10:40:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F76%252Fc976863bb46775e906633c9d16a276b1%252Fpa%252FDU93693_31f3f77416dbb16fcfdc96c7363642a8.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_31f3f77416dbb16fcfdc96c7363642a8.jpg saved to cache
2026-03-28 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1
2026-03-28 10:40:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1, skipping ID generation
2026-03-28 10:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with scrape type 1
2026-03-28 10:40:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 sending to next pipeline
2026-03-28 10:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1, identifier: DU93693
2026-03-28 10:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522
2026-03-28 10:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522
2026-03-28 10:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3 with identifier: LM10522 to the API
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4eb1676c430803f6e492dd36acad1d5f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:17:13Z',
 'fuel_type': 'diesel',
 'id': 'ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM10522',
 'listing': 'auction',
 'location': 'DE, Singen',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 274926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4f38b6e45977a27c87ea2ed11d69bf69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2803798,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_1fae1e85a1742dbffbf579eeb9fadb4e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_707aeeca247fcdad107d1f91ffb4c977.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_6588309f4f765cb563b504ebc5a11cd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_c0bddbc3d0e59055e3cecf446193bfde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_8b2c0afdb015fbce2af00577446d8e6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2894581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4eb1676c430803f6e492dd36acad1d5f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2843292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_4a36b5ae2c3290ebea3b73d1b56d4e66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2749384,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_869cb5f05f7feaed24d989263e0be961.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3/ad54e0c0-b61b-55ee-abb0-63d9dc74a2c3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3064871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/6f/756fdd7338d2fc1558468302a3955c99/pa/LM10522_ed310f49290c5060335d1dbe5fec509c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Saving data for LM10522: {'created_time': 1774694455.470477, 'last_price_update_time': 1774694455.470489, 'auction_closing_time': 1774883833.0}
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM10522') HTTP/1.1" 204 0
2026-03-28 10:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693
2026-03-28 10:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693
2026-03-28 10:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 455d24a2-5900-55ff-bbb8-9baf1e7d7aa1 with identifier: DU93693 to the API
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_31f3f77416dbb16fcfdc96c7363642a8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 244,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:10:42Z',
 'fuel_type': 'diesel',
 'id': '455d24a2-5900-55ff-bbb8-9baf1e7d7aa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU93693',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 151069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3436697,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_31f3f77416dbb16fcfdc96c7363642a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3158944,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_29c4520fbe56d15265387b3f8d6ab236.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3246695,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_bddb695bf4b1eb5f20ce0087c06d08dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2954749,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_ab8de7aaaf7b2e33a7c4d2e22de4cf45.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2984834,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_a4cf56f78e429eb84418a5f2b3294faf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_6f64b1e6668a6d714f70d2fe6a948981.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_b6ac3ef47b6348209199b380eb9cb617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_f0fa3c709cf660988d9777e9a1c13112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_665fe7b7872467a18a00d8219fcfff66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_455d24a2-5900-55ff-bbb8-9baf1e7d7aa1/455d24a2-5900-55ff-bbb8-9baf1e7d7aa1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/76/c976863bb46775e906633c9d16a276b1/pa/DU93693_352cdd83dc185b1def3a9e39153a96fb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI lang Ambiente',
 'transmission': 'automatic',
 'trim': 'lang Ambiente',
 'year': 2009}
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [auto1.de] INFO: Saving data for DU93693: {'created_time': 1774694455.900231, 'last_price_update_time': 1774694455.900246, 'auction_closing_time': 1774883442.0}
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU93693') HTTP/1.1" 204 0
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_d2fb27bd6243c50bd6de3f5c92d5fd99.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_d2fb27bd6243c50bd6de3f5c92d5fd99.jpg not downloaded yet
2026-03-28 10:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SH00876> (referer: https://www.auto1.com/v1/car-details-view/SH00876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE90423> (referer: https://www.auto1.com/v1/car-details-view/XE90423/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_3bfdd32492bab4edb28a0ab875e2ee8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_3bfdd32492bab4edb28a0ab875e2ee8c.jpg not downloaded yet
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_e64335ca4f3f2b4acf689b2c981ca4b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_e64335ca4f3f2b4acf689b2c981ca4b5.jpg not downloaded yet
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_026fa9d25d7419be6767bd43e85b08d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_026fa9d25d7419be6767bd43e85b08d6.jpg not downloaded yet
2026-03-28 10:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876
2026-03-28 10:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a227b5aa-145c-54e8-b216-336963c4b36c with scrape type 1
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_ebddb3cd75e3670c0482e245e36a0409.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_ebddb3cd75e3670c0482e245e36a0409.jpg not downloaded yet
2026-03-28 10:40:56 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 9643 | hits on page: 40
2026-03-28 10:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423
2026-03-28 10:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with scrape type 1
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_b46be9b84705c9a07bc3ad0f12dfe620.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_b46be9b84705c9a07bc3ad0f12dfe620.jpg not downloaded yet
2026-03-28 10:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_a09faf359a004a667902e047bae88a55.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_0c94640f91c2bc3c3fd36faa68bdeeeb.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_0c94640f91c2bc3c3fd36faa68bdeeeb.jpg not downloaded yet
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: EE06188
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: BM57132
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: LF00683
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK01329%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for ZK01329: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for KC24735: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80176%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for EJ80176: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14649%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for SG14649: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for BX53792: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX32204%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for GX32204: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43781%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for UZ43781: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80903%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for AW80903: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA91193%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for KA91193: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: LU01716
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU01716%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for LU01716: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: ES71771
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76424%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for BD76424: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: BL23866
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL23866%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for BL23866: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ94385%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for BJ94385: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB04317%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for WB04317: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV57112%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for KV57112: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80186%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for EM80186: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX45513%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for BX45513: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF70690%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for VF70690: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27254%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for VF27254: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: LW02583
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW02583%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for LW02583: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT00833%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for YT00833: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15583%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for YM15583: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN13100%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for SN13100: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV30078%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for CV30078: 0
2026-03-28 10:40:56 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57223%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [auto1.de] INFO: Scrape type for DV57223: 0
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_c4a7ae44cc3b69471a0c9cc5cc839f56.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_c4a7ae44cc3b69471a0c9cc5cc839f56.jpg not downloaded yet
2026-03-28 10:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_3bfdd32492bab4edb28a0ab875e2ee8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_b7b194bb3c58d0174c3a548cc5f1b717.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_b7b194bb3c58d0174c3a548cc5f1b717.jpg not downloaded yet
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_fbb6e38f42fef05551a18bb2f89bce88.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_fbb6e38f42fef05551a18bb2f89bce88.jpg not downloaded yet
2026-03-28 10:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_d2fb27bd6243c50bd6de3f5c92d5fd99.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_026fa9d25d7419be6767bd43e85b08d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_e64335ca4f3f2b4acf689b2c981ca4b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd1bc90>
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_a09faf359a004a667902e047bae88a55.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_a09faf359a004a667902e047bae88a55.jpg saved to cache
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c24b8bbd-ae61-53d1-968a-013f8bc1496b
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_c4abff42ab4b6d424f69421087049741.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_c4abff42ab4b6d424f69421087049741.jpg not downloaded yet
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_d0f3a14da47f9d5149a1c12ecad02a09.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_d0f3a14da47f9d5149a1c12ecad02a09.jpg not downloaded yet
2026-03-28 10:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_b46be9b84705c9a07bc3ad0f12dfe620.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_c45e2d7e034c61bb479a7587a34b8ff0.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_c45e2d7e034c61bb479a7587a34b8ff0.jpg not downloaded yet
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_a4f20bff771ac6a7bf4b4ff72195166c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_a4f20bff771ac6a7bf4b4ff72195166c.jpg not downloaded yet
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab88ef110>
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_3bfdd32492bab4edb28a0ab875e2ee8c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_3bfdd32492bab4edb28a0ab875e2ee8c.jpg saved to cache
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c24b8bbd-ae61-53d1-968a-013f8bc1496b
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_1661d092b2cd6c8a37e37583d344022d.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_1661d092b2cd6c8a37e37583d344022d.jpg not downloaded yet
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_30a16f7b0c5a74ee30093529a56ffd1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_30a16f7b0c5a74ee30093529a56ffd1f.jpg not downloaded yet
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc22ed0>
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_d2fb27bd6243c50bd6de3f5c92d5fd99.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_d2fb27bd6243c50bd6de3f5c92d5fd99.jpg saved to cache
2026-03-28 10:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c24b8bbd-ae61-53d1-968a-013f8bc1496b
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd19790>
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_026fa9d25d7419be6767bd43e85b08d6.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_026fa9d25d7419be6767bd43e85b08d6.jpg saved to cache
2026-03-28 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c24b8bbd-ae61-53d1-968a-013f8bc1496b
2026-03-28 10:40:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdc610>
2026-03-28 10:40:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F7d%252Fab7d4ad7f4098db7d3bccf28896e7157%252Fpa%252FBW55074_e64335ca4f3f2b4acf689b2c981ca4b5.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_e64335ca4f3f2b4acf689b2c981ca4b5.jpg saved to cache
2026-03-28 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c24b8bbd-ae61-53d1-968a-013f8bc1496b
2026-03-28 10:40:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c24b8bbd-ae61-53d1-968a-013f8bc1496b, skipping ID generation
2026-03-28 10:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c24b8bbd-ae61-53d1-968a-013f8bc1496b with scrape type 1
2026-03-28 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c24b8bbd-ae61-53d1-968a-013f8bc1496b sending to next pipeline
2026-03-28 10:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c24b8bbd-ae61-53d1-968a-013f8bc1496b, identifier: BW55074
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_73bcad41633e63660fef8d04b4e1c1a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_73bcad41633e63660fef8d04b4e1c1a5.jpg not downloaded yet
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_dd7dd3a955aeac5fbaa5f67622adb2df.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_dd7dd3a955aeac5fbaa5f67622adb2df.jpg not downloaded yet
2026-03-28 10:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074
2026-03-28 10:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074
2026-03-28 10:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c24b8bbd-ae61-53d1-968a-013f8bc1496b with identifier: BW55074 to the API
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_e64335ca4f3f2b4acf689b2c981ca4b5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:21:08Z',
 'fuel_type': 'petrol',
 'id': 'c24b8bbd-ae61-53d1-968a-013f8bc1496b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW55074',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 195435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_a09faf359a004a667902e047bae88a55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77162,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_d2fb27bd6243c50bd6de3f5c92d5fd99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_3bfdd32492bab4edb28a0ab875e2ee8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_e64335ca4f3f2b4acf689b2c981ca4b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c24b8bbd-ae61-53d1-968a-013f8bc1496b/c24b8bbd-ae61-53d1-968a-013f8bc1496b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/7d/ab7d4ad7f4098db7d3bccf28896e7157/pa/BW55074_026fa9d25d7419be6767bd43e85b08d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen DS3 1.6 VTi SoChic',
 'transmission': 'manual',
 'trim': 'SoChic',
 'year': 2011}
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [auto1.de] INFO: Saving data for BW55074: {'created_time': 1774694457.789882, 'last_price_update_time': 1774694457.789894, 'auction_closing_time': 1774884068.0}
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW55074') HTTP/1.1" 204 0
2026-03-28 10:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_c4abff42ab4b6d424f69421087049741.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_d0f3a14da47f9d5149a1c12ecad02a09.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_2297ff15535d4189a95069ceea3de28b.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_2297ff15535d4189a95069ceea3de28b.jpg not downloaded yet
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_c5e114b38ba9d4ab881ec8cce3e46cd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_c5e114b38ba9d4ab881ec8cce3e46cd3.jpg not downloaded yet
2026-03-28 10:40:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8da10>
2026-03-28 10:40:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_b46be9b84705c9a07bc3ad0f12dfe620.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_b46be9b84705c9a07bc3ad0f12dfe620.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_5f1452d505c0184c651b758429ca6b42.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_5f1452d505c0184c651b758429ca6b42.jpg not downloaded yet
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_5c602b6985d16cc0319e053541755117.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_5c602b6985d16cc0319e053541755117.jpg not downloaded yet
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_1a28cea3793f769322beeff92af7bf3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_1a28cea3793f769322beeff92af7bf3c.jpg not downloaded yet
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_e9c895d8383f3099928523cb5cb77152.jpg%27 HTTP/1.1" 200 None
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_e9c895d8383f3099928523cb5cb77152.jpg not downloaded yet
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab89f9b90>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_c4abff42ab4b6d424f69421087049741.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_c4abff42ab4b6d424f69421087049741.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc21bd0>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_3.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_d0f3a14da47f9d5149a1c12ecad02a09.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_d0f3a14da47f9d5149a1c12ecad02a09.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_a4f20bff771ac6a7bf4b4ff72195166c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_c45e2d7e034c61bb479a7587a34b8ff0.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_30a16f7b0c5a74ee30093529a56ffd1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_ebddb3cd75e3670c0482e245e36a0409.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_b7b194bb3c58d0174c3a548cc5f1b717.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_0c94640f91c2bc3c3fd36faa68bdeeeb.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_c4a7ae44cc3b69471a0c9cc5cc839f56.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_fbb6e38f42fef05551a18bb2f89bce88.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd8b0d0>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_a4f20bff771ac6a7bf4b4ff72195166c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_a4f20bff771ac6a7bf4b4ff72195166c.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfc6590>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_c45e2d7e034c61bb479a7587a34b8ff0.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_c45e2d7e034c61bb479a7587a34b8ff0.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd4d990>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_30a16f7b0c5a74ee30093529a56ffd1f.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_30a16f7b0c5a74ee30093529a56ffd1f.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:40:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfde910>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_ebddb3cd75e3670c0482e245e36a0409.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_ebddb3cd75e3670c0482e245e36a0409.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf94a10>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_b7b194bb3c58d0174c3a548cc5f1b717.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_b7b194bb3c58d0174c3a548cc5f1b717.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabfdc610>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_0c94640f91c2bc3c3fd36faa68bdeeeb.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_0c94640f91c2bc3c3fd36faa68bdeeeb.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_dd7dd3a955aeac5fbaa5f67622adb2df.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_1661d092b2cd6c8a37e37583d344022d.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_73bcad41633e63660fef8d04b4e1c1a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:40:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabda71d0>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_1.jpg HTTP/1.1" 201 0
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_c4a7ae44cc3b69471a0c9cc5cc839f56.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_c4a7ae44cc3b69471a0c9cc5cc839f56.jpg saved to cache
2026-03-28 10:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:40:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabecb410>
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_2.jpg HTTP/1.1" 201 0
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_fbb6e38f42fef05551a18bb2f89bce88.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_fbb6e38f42fef05551a18bb2f89bce88.jpg saved to cache
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd34fd0>
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_dd7dd3a955aeac5fbaa5f67622adb2df.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_dd7dd3a955aeac5fbaa5f67622adb2df.jpg saved to cache
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd9c090>
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_1661d092b2cd6c8a37e37583d344022d.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_1661d092b2cd6c8a37e37583d344022d.jpg saved to cache
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabc22ad0>
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_73bcad41633e63660fef8d04b4e1c1a5.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_73bcad41633e63660fef8d04b4e1c1a5.jpg saved to cache
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:59 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 9643 | hits on page: 40
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: BC73900
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for FK07510: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU94869%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for PU94869: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: CF34401
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF34401%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for CF34401: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: TJ50695
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50695%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for TJ50695: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV05588%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for SV05588: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: JB03080
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT65416%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for KT65416: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: UK84754
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: BX84490
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX84490%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for BX84490: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for ZA25327: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for UB59521: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: WN78953
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN78953%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for WN78953: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: LK11873
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK11873%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for LK11873: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72396%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for RV72396: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU59921%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for GU59921: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC05500%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for HC05500: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ74816%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for ZZ74816: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW69749%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for LW69749: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: US80422
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: PT81220
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for ZD67638: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL70058%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for KL70058: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET94101%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for ET94101: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH85059%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for AH85059: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78678%27 HTTP/1.1" 200 None
2026-03-28 10:40:59 [auto1.de] INFO: Scrape type for LK78678: 0
2026-03-28 10:40:59 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-28 10:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_1a28cea3793f769322beeff92af7bf3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_2297ff15535d4189a95069ceea3de28b.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_5f1452d505c0184c651b758429ca6b42.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_c5e114b38ba9d4ab881ec8cce3e46cd3.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_e9c895d8383f3099928523cb5cb77152.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_5c602b6985d16cc0319e053541755117.jpg> (referer: https://www.auto1.com/)
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf8abd0>
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_1a28cea3793f769322beeff92af7bf3c.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_1a28cea3793f769322beeff92af7bf3c.jpg saved to cache
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf8a4d0>
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_2297ff15535d4189a95069ceea3de28b.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_2297ff15535d4189a95069ceea3de28b.jpg saved to cache
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3ab890af90>
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:40:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F4e%252Fde4e731d0bc8f7d9edced39a85d50626%252Fpa%252FSH00876_5f1452d505c0184c651b758429ca6b42.jpg') HTTP/1.1" 204 0
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_5f1452d505c0184c651b758429ca6b42.jpg saved to cache
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a227b5aa-145c-54e8-b216-336963c4b36c
2026-03-28 10:40:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a227b5aa-145c-54e8-b216-336963c4b36c, skipping ID generation
2026-03-28 10:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a227b5aa-145c-54e8-b216-336963c4b36c with scrape type 1
2026-03-28 10:40:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a227b5aa-145c-54e8-b216-336963c4b36c sending to next pipeline
2026-03-28 10:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a227b5aa-145c-54e8-b216-336963c4b36c, identifier: SH00876
2026-03-28 10:41:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf5c610>
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_7.jpg HTTP/1.1" 201 0
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_c5e114b38ba9d4ab881ec8cce3e46cd3.jpg') HTTP/1.1" 204 0
2026-03-28 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_c5e114b38ba9d4ab881ec8cce3e46cd3.jpg saved to cache
2026-03-28 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876
2026-03-28 10:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876
2026-03-28 10:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a227b5aa-145c-54e8-b216-336963c4b36c with identifier: SH00876 to the API
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_5f1452d505c0184c651b758429ca6b42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 212,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:22:42Z',
 'fuel_type': 'diesel',
 'id': 'a227b5aa-145c-54e8-b216-336963c4b36c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH00876',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 129795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2650801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_ebddb3cd75e3670c0482e245e36a0409.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_0c94640f91c2bc3c3fd36faa68bdeeeb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2417717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_b7b194bb3c58d0174c3a548cc5f1b717.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_c4abff42ab4b6d424f69421087049741.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_c45e2d7e034c61bb479a7587a34b8ff0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_1661d092b2cd6c8a37e37583d344022d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_73bcad41633e63660fef8d04b4e1c1a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2548254,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_2297ff15535d4189a95069ceea3de28b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2520230,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_5f1452d505c0184c651b758429ca6b42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a227b5aa-145c-54e8-b216-336963c4b36c/a227b5aa-145c-54e8-b216-336963c4b36c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/4e/de4e731d0bc8f7d9edced39a85d50626/pa/SH00876_1a28cea3793f769322beeff92af7bf3c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-13',
 'seats_number': 8,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d extralang Avantgarde',
 'transmission': 'automatic',
 'trim': 'extralang Avantgarde',
 'year': 2019}
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-28 10:41:00 [auto1.de] INFO: Saving data for SH00876: {'created_time': 1774694460.726262, 'last_price_update_time': 1774694460.726272, 'auction_closing_time': 1774884162.0}
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH00876') HTTP/1.1" 204 0
2026-03-28 10:41:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabf70110>
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_9.jpg HTTP/1.1" 201 0
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_e9c895d8383f3099928523cb5cb77152.jpg') HTTP/1.1" 204 0
2026-03-28 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_e9c895d8383f3099928523cb5cb77152.jpg saved to cache
2026-03-28 10:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:41:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3aabd31510>
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 10:41:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 10:41:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_8.jpg HTTP/1.1" 201 0
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252F9c%252Fe99c4973687b635114c1ea7e9437801d%252Fpa%252FXE90423_5c602b6985d16cc0319e053541755117.jpg') HTTP/1.1" 204 0
2026-03-28 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_5c602b6985d16cc0319e053541755117.jpg saved to cache
2026-03-28 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db
2026-03-28 10:41:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db, skipping ID generation
2026-03-28 10:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with scrape type 1
2026-03-28 10:41:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db sending to next pipeline
2026-03-28 10:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db, identifier: XE90423
2026-03-28 10:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423
2026-03-28 10:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423
2026-03-28 10:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db with identifier: XE90423 to the API
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_5c602b6985d16cc0319e053541755117.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 188,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:27:50Z',
 'fuel_type': 'petrol',
 'id': 'd2a2ebd6-dd39-5bb7-9a8e-a513bfa537db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE90423',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 119409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_b46be9b84705c9a07bc3ad0f12dfe620.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3188233,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_c4a7ae44cc3b69471a0c9cc5cc839f56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3291636,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_fbb6e38f42fef05551a18bb2f89bce88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_d0f3a14da47f9d5149a1c12ecad02a09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_a4f20bff771ac6a7bf4b4ff72195166c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_30a16f7b0c5a74ee30093529a56ffd1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_dd7dd3a955aeac5fbaa5f67622adb2df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589403,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_c5e114b38ba9d4ab881ec8cce3e46cd3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3127480,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_5c602b6985d16cc0319e053541755117.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db/d2a2ebd6-dd39-5bb7-9a8e-a513bfa537db_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3264569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/9c/e99c4973687b635114c1ea7e9437801d/pa/XE90423_e9c895d8383f3099928523cb5cb77152.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2019}
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Saving data for XE90423: {'created_time': 1774694461.648944, 'last_price_update_time': 1774694461.648958, 'auction_closing_time': 1774884470.0}
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE90423') HTTP/1.1" 204 0
2026-03-28 10:41:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:01 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 9643 | hits on page: 40
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for VA54301: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ68996%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for YJ68996: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: TB15479
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15479%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for TB15479: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76015%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for CS76015: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: TE23487
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88982%27 HTTP/1.1" 200 None
2026-03-28 10:41:01 [auto1.de] INFO: Scrape type for HG88982: 0
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-28 10:41:01 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-28 10:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for ST04128: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43090%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for UZ43090: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: PJ23427
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU32595%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for BU32595: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for EV58982: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH55749%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for SH55749: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ68009%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for JJ68009: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN88282%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for EN88282: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: TC10738
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC10738%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for TC10738: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42354%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for BZ42354: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM58161%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for CM58161: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN36712%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for AN36712: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10948%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for RX10948: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH92759%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for VH92759: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML67017%27 HTTP/1.1" 200 None
2026-03-28 10:41:02 [auto1.de] INFO: Scrape type for ML67017: 0
2026-03-28 10:41:02 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-28 10:41:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:03 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT27495%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for TT27495: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD03678%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for CD03678: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX41654%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for GX41654: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for YT52370: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: VV75383
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV75383%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for VV75383: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ97715%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for SZ97715: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC37462%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for KC37462: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: RB39093
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB39093%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for RB39093: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: FX57031
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX57031%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for FX57031: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: MF29481
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM88586%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for PM88586: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for EV97888: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13409%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for TR13409: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW97412%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for GW97412: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: GE07622
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: YB13434
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB13434%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for YB13434: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG84508%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for LG84508: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: DN72961
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN72961%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for DN72961: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ31328%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for MJ31328: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS82974%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for XS82974: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39417%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for GH39417: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD21444%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for BD21444: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK50070%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for HK50070: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: AB20934
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: FX68518
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14297%27 HTTP/1.1" 200 None
2026-03-28 10:41:03 [auto1.de] INFO: Scrape type for SG14297: 0
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-28 10:41:03 [auto1.de] INFO: Found listing with ID: JF90132
2026-03-28 10:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:04 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: CU59576
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU59576%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for CU59576: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER31380%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for ER31380: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ24379%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for XJ24379: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP78752%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for DP78752: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: LJ89575
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU93919%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for YU93919: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM30450%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for CM30450: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT06802%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for PT06802: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH30601%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for CH30601: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA42451%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for MA42451: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK24290%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for HK24290: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81340%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for BP81340: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: MX06399
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX06399%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for MX06399: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: XX93407
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX93407%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for XX93407: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: SE90134
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: GN38725
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN38725%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for GN38725: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: LZ73425
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: PV39921
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV39921%27 HTTP/1.1" 200 None
2026-03-28 10:41:04 [auto1.de] INFO: Scrape type for PV39921: 0
2026-03-28 10:41:04 [auto1.de] INFO: Found listing with ID: UM40776
2026-03-28 10:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM40776%27 HTTP/1.1" 200 None
2026-03-28 10:41:05 [auto1.de] INFO: Scrape type for UM40776: 0
2026-03-28 10:41:05 [auto1.de] INFO: Found listing with ID: PR48691
2026-03-28 10:41:05 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-28 10:41:05 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD47381%27 HTTP/1.1" 200 None
2026-03-28 10:41:05 [auto1.de] INFO: Scrape type for WD47381: 0
2026-03-28 10:41:05 [auto1.de] INFO: Found listing with ID: BX52311
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52311%27 HTTP/1.1" 200 None
2026-03-28 10:41:05 [auto1.de] INFO: Scrape type for BX52311: 0
2026-03-28 10:41:05 [auto1.de] INFO: Found listing with ID: HF45615
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF45615%27 HTTP/1.1" 200 None
2026-03-28 10:41:05 [auto1.de] INFO: Scrape type for HF45615: 0
2026-03-28 10:41:05 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-28 10:41:05 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK98498%27 HTTP/1.1" 200 None
2026-03-28 10:41:05 [auto1.de] INFO: Scrape type for MK98498: 0
2026-03-28 10:41:05 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63697%27 HTTP/1.1" 200 None
2026-03-28 10:41:05 [auto1.de] INFO: Scrape type for XB63697: 0
2026-03-28 10:41:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:06 [scrapy.extensions.logstats] INFO: Crawled 235 pages (at 46 pages/min), scraped 188 items (at 55 items/min)
2026-03-28 10:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:41:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:08 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 9643 | hits on page: 40
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU76337%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for NU76337: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: TE36715
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE19972%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for NE19972: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: KN06513
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: EX28790
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX28790%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for EX28790: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB28690%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for UB28690: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: GE34935
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE34935%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for GE34935: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES37621%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for ES37621: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: LK84028
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM07569%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for JM07569: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: FV70322
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR02584%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for GR02584: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: RG19382
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: JB27524
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP25295%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for VP25295: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: DV44550
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: MN73743
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ66077%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for NJ66077: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: XG23027
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: UV23463
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV23463%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for UV23463: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: KX75586
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23265%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for JD23265: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT14298%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for GT14298: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: AZ36706
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: CC17090
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53394%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for KL53394: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for LS65332: 0
2026-03-28 10:41:08 [auto1.de] INFO: Found listing with ID: EB80315
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB80315%27 HTTP/1.1" 200 None
2026-03-28 10:41:08 [auto1.de] INFO: Scrape type for EB80315: 0
2026-03-28 10:41:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:09 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: EB80315
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB80315%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for EB80315: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: TK28110
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: TB76582
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: FW04904
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW04904%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for FW04904: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: GK45349
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK45349%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for GK45349: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: YR17987
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: ZP12024
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for MF56816: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for BE83152: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: HG90812
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: ZT59384
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: KK74048
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK74048%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for KK74048: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: PY20785
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: TA25179
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25179%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for TA25179: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: VK99504
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK99504%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for VK99504: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: NF92899
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE14691%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for BE14691: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: HK08818
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK08818%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for HK08818: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for NU04580: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: YR03483
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: VK29322
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: XK43305
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK43305%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for XK43305: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for WC33817: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: JZ88566
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ88566%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for JZ88566: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: JE79416
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: SX40861
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40861%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for SX40861: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY95504%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for DY95504: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: MJ40039
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: PH95596
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH95596%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for PH95596: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: LH77373
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH77373%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for LH77373: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: UG43365
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG43365%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for UG43365: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: HP12660
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12660%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for HP12660: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: UD40582
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD40582%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for UD40582: 0
2026-03-28 10:41:09 [auto1.de] INFO: Found listing with ID: PU06584
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU06584%27 HTTP/1.1" 200 None
2026-03-28 10:41:09 [auto1.de] INFO: Scrape type for PU06584: 0
2026-03-28 10:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:10 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: XA03133
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: UP05296
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP05296%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for UP05296: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: FJ62780
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: JE58161
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE58161%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for JE58161: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB15265%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for BB15265: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: RW16668
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for RC23376: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: NZ53793
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: GV92310
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: UC51546
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: NV63188
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: UG57897
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG57897%27 HTTP/1.1" 200 None
2026-03-28 10:41:10 [auto1.de] INFO: Scrape type for UG57897: 0
2026-03-28 10:41:10 [auto1.de] INFO: Found listing with ID: ZC12806
2026-03-28 10:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC12806%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for ZC12806: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: SM33942
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM33942%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for SM33942: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: BW22563
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: CH92359
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: VP44882
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: PU27308
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: MF99655
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF99655%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for MF99655: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: KF20598
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF20598%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for KF20598: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: JE92990
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT69735%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for CT69735: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: WV63025
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR70794%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for NR70794: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: NZ80756
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ80756%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for NZ80756: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: CW24668
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: DL13353
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: MA94395
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: GZ91789
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: XE14279
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: SG32034
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG32034%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for SG32034: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ13921%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for KZ13921: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: FC39269
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC39269%27 HTTP/1.1" 200 None
2026-03-28 10:41:11 [auto1.de] INFO: Scrape type for FC39269: 0
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: GF71655
2026-03-28 10:41:11 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-28 10:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:12 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: FW21931
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW21931%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for FW21931: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: WZ12668
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: ZR53559
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR53559%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for ZR53559: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for YT11339: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: TX72935
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX72935%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for TX72935: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: UM61936
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM61936%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for UM61936: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: AM47417
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: UG86555
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG86555%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for UG86555: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: XV41644
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV41644%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for XV41644: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: NA57032
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA57032%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for NA57032: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for XJ33844: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: SK50267
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK50267%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for SK50267: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: BS50452
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for TZ90006: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: UD72248
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: TE29693
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE29693%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for TE29693: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: CE63611
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL75790%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for UL75790: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: NE03141
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE03141%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for NE03141: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: CH49236
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH49236%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for CH49236: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: SV49639
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV49639%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for SV49639: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for RB67874: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for BD68188: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: XS52546
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS52546%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for XS52546: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN21542%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for EN21542: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK95286%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for AK95286: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: BB62931
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: MA30458
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA30458%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for MA30458: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: XF22574
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF22574%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for XF22574: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for ZR39968: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: CP53358
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP53358%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for CP53358: 0
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: CA88273
2026-03-28 10:41:12 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-28 10:41:12 [auto1.de] INFO: Scrape type for HG88240: 0
2026-03-28 10:41:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:18 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: YJ97695
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ97695%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for YJ97695: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for EW02544: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for HW68760: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: ZN04529
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for AN41414: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: KF35020
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF35020%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for KF35020: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: JM94296
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: NH88126
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: EU09282
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU09282%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for EU09282: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for KA83953: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: PX72797
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX72797%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for PX72797: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: KX24759
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA80165%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for SA80165: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: PB81090
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB81090%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for PB81090: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: BE30085
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for SP97012: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: FH28762
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH28762%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for FH28762: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: LC01994
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC01994%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for LC01994: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: GF50389
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: PB92284
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB92284%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for PB92284: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for RP65815: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: CV06251
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: NK69314
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: EP32297
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: DD38415
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: GC53073
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53073%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for GC53073: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for BZ91725: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR98876%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for WR98876: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: GZ10091
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ10091%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for GZ10091: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: KY36378
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY36378%27 HTTP/1.1" 200 None
2026-03-28 10:41:18 [auto1.de] INFO: Scrape type for KY36378: 0
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: EC83870
2026-03-28 10:41:18 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-28 10:41:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:20 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: CS62800
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS62800%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for CS62800: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for JG35901: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: FD48176
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: GH78103
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: BB98508
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98508%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for BB98508: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: AL65001
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL65001%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for AL65001: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for RM44288: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: UT62176
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62176%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for UT62176: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: VE76243
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE76243%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for VE76243: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: LF06916
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for RJ18784: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: RT59975
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT59975%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for RT59975: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: BK98649
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: EW88282
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for MY48051: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for SP90277: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: PB50731
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59883%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for UA59883: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: PP27281
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP27281%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for PP27281: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for XP68837: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-28 10:41:20 [auto1.de] INFO: Scrape type for NY57954: 0
2026-03-28 10:41:20 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-28 10:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for SN40806: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: UN02057
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN02057%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for UN02057: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for JK52723: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: VR87804
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR87804%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for VR87804: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG80613%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for KG80613: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: LG37465
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG37465%27 HTTP/1.1" 200 None
2026-03-28 10:41:21 [auto1.de] INFO: Scrape type for LG37465: 0
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: MH85381
2026-03-28 10:41:21 [auto1.de] INFO: Found listing with ID: AT55034
2026-03-28 10:41:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:24 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-28 10:41:24 [auto1.de] INFO: Scrape type for KN98252: 0
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: HY54013
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-28 10:41:24 [auto1.de] INFO: Scrape type for DN02562: 0
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: PM99393
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM99393%27 HTTP/1.1" 200 None
2026-03-28 10:41:24 [auto1.de] INFO: Scrape type for PM99393: 0
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84716%27 HTTP/1.1" 200 None
2026-03-28 10:41:24 [auto1.de] INFO: Scrape type for KV84716: 0
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: FD57756
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: PY40149
2026-03-28 10:41:24 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-28 10:41:24 [auto1.de] INFO: Scrape type for RJ73659: 2
2026-03-28 10:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e654da7-33d3-5122-9012-128ab9ba0d97 with identifier: RJ73659
2026-03-28 10:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e654da7-33d3-5122-9012-128ab9ba0d97 with scrape type 2
2026-03-28 10:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e654da7-33d3-5122-9012-128ab9ba0d97 with scrape type 2
2026-03-28 10:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e654da7-33d3-5122-9012-128ab9ba0d97, identifier: RJ73659
2026-03-28 10:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e654da7-33d3-5122-9012-128ab9ba0d97 with identifier: RJ73659
2026-03-28 10:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e654da7-33d3-5122-9012-128ab9ba0d97 with identifier: RJ73659
2026-03-28 10:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e654da7-33d3-5122-9012-128ab9ba0d97 with identifier: RJ73659 to the API
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:30:59Z',
 'fuel_type': 'petrol',
 'id': '2e654da7-33d3-5122-9012-128ab9ba0d97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ73659',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Patriot',
 'odometer': 218414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-24',
 'seller_name': None,
 'title': 'Jeep Patriot 2.4 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2010}
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-28 10:41:24 [auto1.de] INFO: Saving data for RJ73659: {'auction_closing_time': 1774715459.0, 'created_time': 1774510547.209475, 'last_price_update_time': 1774694484.95707}
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ73659') HTTP/1.1" 204 0
2026-03-28 10:41:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: DL36324
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: PP65062
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP65062%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for PP65062: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: KM25194
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM25194%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for KM25194: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for JD41613: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: RK08384
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: LV91095
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV91095%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for LV91095: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: PF34298
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF34298%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for PF34298: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE40777%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for GE40777: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY72609%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for DY72609: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: UG55505
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG55505%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for UG55505: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: JX74637
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: MH26074
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for LL99453: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: LR13115
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: XL27476
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: ZN11262
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: ZE37210
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: SD08227
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD08227%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for SD08227: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for CN91045: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: XA31743
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: BS93461
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: YH28050
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH28050%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for YH28050: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: EE18812
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE18812%27 HTTP/1.1" 200 None
2026-03-28 10:41:25 [auto1.de] INFO: Scrape type for EE18812: 0
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-28 10:41:25 [auto1.de] INFO: Found listing with ID: JA88667
2026-03-28 10:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:26 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 9644 | hits on page: 40
2026-03-28 10:41:26 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-28 10:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for NL93561: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX13795%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for LX13795: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: XA47491
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA47491%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for XA47491: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: KL79977
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79977%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for KL79977: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: VL10469
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: WZ55342
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for GM93561: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for XX63179: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: NJ70051
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: YJ74621
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ74621%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for YJ74621: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: XY04556
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY04556%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for XY04556: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: GN33962
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: CH37782
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX09791%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for JX09791: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: TH10598
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: KE28324
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE28324%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for KE28324: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW57264%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for SW57264: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: WC60331
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC60331%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for WC60331: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: WP53621
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP53621%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for WP53621: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: AL02035
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: UP80986
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80986%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for UP80986: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: YT12471
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12471%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for YT12471: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: KJ32312
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: UJ67578
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ67578%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for UJ67578: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for XP92221: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: BT20350
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for LN92590: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: TV15766
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS07911%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for KS07911: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY72197%27 HTTP/1.1" 200 None
2026-03-28 10:41:27 [auto1.de] INFO: Scrape type for UY72197: 0
2026-03-28 10:41:27 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-28 10:41:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:31 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 9645 | hits on page: 40
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: JT25631
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: BY14776
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14776%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for BY14776: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: BH50029
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: FG40376
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG40376%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for FG40376: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU76842%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for LU76842: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: JA95391
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: DF25786
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF25786%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for DF25786: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: RL14403
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL14403%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for RL14403: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for CP27370: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: PU08613
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: VM29679
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM29679%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for VM29679: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: DS79921
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: YM33158
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for MA12811: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: JZ03470
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: YV00461
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV00461%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for YV00461: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: RP49857
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: WR52929
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR52929%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for WR52929: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: UM76329
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76329%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for UM76329: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: PE28100
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: VC21534
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC21534%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for VC21534: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: CM07244
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM07244%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for CM07244: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: FT76728
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT76728%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for FT76728: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: ES78783
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES78783%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for ES78783: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: ZY80626
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80626%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for ZY80626: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: SZ29379
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ29379%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for SZ29379: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: LK88331
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: JG57844
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG57844%27 HTTP/1.1" 200 None
2026-03-28 10:41:31 [auto1.de] INFO: Scrape type for JG57844: 0
2026-03-28 10:41:31 [auto1.de] INFO: Found listing with ID: WR65399
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR65399%27 HTTP/1.1" 200 None
2026-03-28 10:41:32 [auto1.de] INFO: Scrape type for WR65399: 0
2026-03-28 10:41:32 [auto1.de] INFO: Found listing with ID: MH95241
2026-03-28 10:41:32 [auto1.de] INFO: Found listing with ID: MJ83876
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ83876%27 HTTP/1.1" 200 None
2026-03-28 10:41:32 [auto1.de] INFO: Scrape type for MJ83876: 0
2026-03-28 10:41:32 [auto1.de] INFO: Found listing with ID: DX81242
2026-03-28 10:41:32 [auto1.de] INFO: Found listing with ID: MF03650
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03650%27 HTTP/1.1" 200 None
2026-03-28 10:41:32 [auto1.de] INFO: Scrape type for MF03650: 2
2026-03-28 10:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5802ca65-864b-5eb9-9270-6e16961f359f with identifier: MF03650
2026-03-28 10:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5802ca65-864b-5eb9-9270-6e16961f359f with scrape type 2
2026-03-28 10:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5802ca65-864b-5eb9-9270-6e16961f359f with scrape type 2
2026-03-28 10:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5802ca65-864b-5eb9-9270-6e16961f359f, identifier: MF03650
2026-03-28 10:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5802ca65-864b-5eb9-9270-6e16961f359f with identifier: MF03650
2026-03-28 10:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5802ca65-864b-5eb9-9270-6e16961f359f with identifier: MF03650
2026-03-28 10:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5802ca65-864b-5eb9-9270-6e16961f359f with identifier: MF03650 to the API
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:42:13Z',
 'fuel_type': 'petrol',
 'id': '5802ca65-864b-5eb9-9270-6e16961f359f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF03650',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 240297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-09',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2013}
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03650%27 HTTP/1.1" 200 None
2026-03-28 10:41:32 [auto1.de] INFO: Saving data for MF03650: {'auction_closing_time': 1774716133.0, 'created_time': 1773380624.774804, 'last_price_update_time': 1774694492.907302}
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF03650') HTTP/1.1" 204 0
2026-03-28 10:41:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:41:33 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-28 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG52732%27 HTTP/1.1" 200 None
2026-03-28 10:41:33 [auto1.de] INFO: Scrape type for XG52732: 0
2026-03-28 10:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:41:53 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 9646 | hits on page: 40
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG52732%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for XG52732: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: DE69503
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69503%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for DE69503: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: SE45637
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE45637%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for SE45637: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: CW35231
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW35231%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for CW35231: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for JP43917: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: UT80766
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT80766%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for UT80766: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: MP12786
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP12786%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for MP12786: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: PG06608
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: BA53965
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA53965%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for BA53965: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: BM06383
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM06383%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for BM06383: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ07036%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for HJ07036: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: XL53582
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL53582%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for XL53582: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: CC01881
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: VA45757
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA45757%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for VA45757: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: DH52741
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH52741%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for DH52741: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: LS93174
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS93174%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for LS93174: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: UM55631
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM55631%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for UM55631: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG43270%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for BG43270: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: US98158
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for SE09507: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: XZ97961
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ97961%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for XZ97961: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: AZ98687
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ98687%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for AZ98687: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: MX80513
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for HY91019: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: SP10962
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10962%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for SP10962: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: DL48053
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL48053%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for DL48053: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: MH16408
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH16408%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for MH16408: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: XW43121
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW43121%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for XW43121: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: WN08657
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN08657%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for WN08657: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: WJ49334
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ49334%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for WJ49334: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: CX66529
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX66529%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for CX66529: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: KA23374
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: NR02271
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: ZC85664
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC85664%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for ZC85664: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: DJ88162
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ88162%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for DJ88162: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: BY78150
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY78150%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for BY78150: 0
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: KT69264
2026-03-28 10:41:53 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-28 10:41:53 [auto1.de] INFO: Scrape type for LJ58036: 2
2026-03-28 10:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036
2026-03-28 10:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96122428-d793-559c-8524-837455f005f7 with scrape type 2
2026-03-28 10:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96122428-d793-559c-8524-837455f005f7 with scrape type 2
2026-03-28 10:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96122428-d793-559c-8524-837455f005f7, identifier: LJ58036
2026-03-28 10:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036
2026-03-28 10:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036
2026-03-28 10:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96122428-d793-559c-8524-837455f005f7 with identifier: LJ58036 to the API
2026-03-28 10:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:41:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:03:48Z',
 'fuel_type': 'petrol',
 'id': '96122428-d793-559c-8524-837455f005f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ58036',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 146505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-28 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-28 10:41:54 [auto1.de] INFO: Saving data for LJ58036: {'auction_closing_time': 1774713828.0, 'created_time': 1774510535.21847, 'last_price_update_time': 1774694514.349932}
2026-03-28 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ58036') HTTP/1.1" 204 0
2026-03-28 10:41:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:06 [scrapy.extensions.logstats] INFO: Crawled 245 pages (at 10 pages/min), scraped 191 items (at 3 items/min)
2026-03-28 10:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:10 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 9647 | hits on page: 40
2026-03-28 10:42:10 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-28 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-28 10:42:10 [auto1.de] INFO: Scrape type for LJ58036: 0
2026-03-28 10:42:10 [auto1.de] INFO: Found listing with ID: GZ46428
2026-03-28 10:42:10 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-28 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-28 10:42:10 [auto1.de] INFO: Scrape type for HK34206: 0
2026-03-28 10:42:10 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-28 10:42:10 [auto1.de] INFO: Found listing with ID: VU46856
2026-03-28 10:42:10 [auto1.de] INFO: Found listing with ID: YH17193
2026-03-28 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH17193%27 HTTP/1.1" 200 None
2026-03-28 10:42:10 [auto1.de] INFO: Scrape type for YH17193: 0
2026-03-28 10:42:10 [auto1.de] INFO: Found listing with ID: BU83638
2026-03-28 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU83638%27 HTTP/1.1" 200 None
2026-03-28 10:42:10 [auto1.de] INFO: Scrape type for BU83638: 0
2026-03-28 10:42:10 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-28 10:42:10 [auto1.de] INFO: Found listing with ID: HR39540
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR39540%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for HR39540: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: RS35479
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS35479%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for RS35479: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS51511%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for WS51511: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: WC43161
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC43161%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for WC43161: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: YM50991
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM50991%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for YM50991: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for TS98939: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: JG32595
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: WK54006
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: LZ37842
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ37842%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for LZ37842: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for EV72489: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: VG17915
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: TD10276
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD10276%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for TD10276: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: EG12940
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: TZ50604
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ50604%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for TZ50604: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98691%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for TS98691: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: LB13606
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB13606%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for LB13606: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: AT93996
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT93996%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for AT93996: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: TX27115
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for PT15230: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: WX48966
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX48966%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for WX48966: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: UT79910
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: PD39203
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD39203%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for PD39203: 0
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-28 10:42:11 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES39418%27 HTTP/1.1" 200 None
2026-03-28 10:42:11 [auto1.de] INFO: Scrape type for ES39418: 0
2026-03-28 10:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:12 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 9647 | hits on page: 40
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: AN31553
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: FC70862
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: WL01890
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: AG44550
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44550%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for AG44550: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA05830%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for PA05830: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: UH79601
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH79601%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for UH79601: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for GB19657: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: LH02136
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH02136%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for LH02136: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59786%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for RH59786: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: BU66338
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: YK08772
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: YV33202
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV33202%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for YV33202: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: PY30467
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: DK13262
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK13262%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for DK13262: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for VX41895: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: GD02743
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF00427%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for LF00427: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: MY00361
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY00361%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for MY00361: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: MH07331
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH07331%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for MH07331: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: HL85444
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL85444%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for HL85444: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for DZ95000: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: JW50887
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: NV12597
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: XM88485
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM88485%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for XM88485: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT03032%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for XT03032: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: MW79572
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for NE74286: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: VF88904
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: XB94191
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB94191%27 HTTP/1.1" 200 None
2026-03-28 10:42:12 [auto1.de] INFO: Scrape type for XB94191: 0
2026-03-28 10:42:12 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-28 10:42:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:46 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 9647 | hits on page: 40
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: KY82766
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP96455%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for EP96455: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: TP36932
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for SS86318: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: TC07570
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC07570%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for TC07570: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: XT11627
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ05672%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for CZ05672: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: AT18561
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: ZY97327
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY97327%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for ZY97327: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68106%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for ES68106: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: PV88809
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: GP39031
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP39031%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for GP39031: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM28041%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for ZM28041: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for TJ20795: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: WZ91552
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: TA55344
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for MF63690: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: VH13590
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: TU13960
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13960%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for TU13960: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: LA33826
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: KA93370
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for DR68264: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: YU32339
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: GL86487
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: TN44984
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: SY69766
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: LB62140
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB62140%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for LB62140: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: WT89497
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT89497%27 HTTP/1.1" 200 None
2026-03-28 10:42:46 [auto1.de] INFO: Scrape type for WT89497: 0
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: VC12091
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: HN27316
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-28 10:42:46 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-28 10:42:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:47 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 9648 | hits on page: 40
2026-03-28 10:42:47 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-28 10:42:47 [auto1.de] INFO: Found listing with ID: HH63715
2026-03-28 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH63715%27 HTTP/1.1" 200 None
2026-03-28 10:42:47 [auto1.de] INFO: Scrape type for HH63715: 0
2026-03-28 10:42:47 [auto1.de] INFO: Found listing with ID: HP91668
2026-03-28 10:42:47 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-28 10:42:47 [auto1.de] INFO: Found listing with ID: RG80046
2026-03-28 10:42:47 [auto1.de] INFO: Found listing with ID: HE16433
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE16433%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for HE16433: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: GD20981
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD20981%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for GD20981: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: WP39257
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: SY31818
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: LF70646
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF70646%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for LF70646: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: ZZ21826
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: GE17394
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE17394%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for GE17394: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for LA48706: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: YE65319
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF76763%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for AF76763: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: DC40385
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: ZM52158
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: ZN33524
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN33524%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for ZN33524: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: AT13824
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: JM14799
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14799%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for JM14799: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR01056%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for XR01056: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: BE73867
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for WZ86962: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: RJ57220
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for BS30478: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for ZH34670: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: XA84499
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA84499%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for XA84499: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: KZ90725
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: DH93175
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH93175%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for DH93175: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for XF69711: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: LB61549
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-28 10:42:48 [auto1.de] INFO: Scrape type for PU85783: 0
2026-03-28 10:42:48 [auto1.de] INFO: Found listing with ID: XM69109
2026-03-28 10:42:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:42:50 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 9648 | hits on page: 40
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: NU93751
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: JB42175
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB42175%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for JB42175: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: RW58482
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: XJ35206
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ35206%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for XJ35206: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: YG99324
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG99324%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for YG99324: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: FJ74613
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74613%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for FJ74613: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: PR99901
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR99901%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for PR99901: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: CM46139
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: EJ87927
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ87927%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for EJ87927: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83793%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for TU83793: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: LE56152
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE56152%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for LE56152: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: TB03254
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for AJ08614: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: EZ42588
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: XP66514
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: DL58213
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL58213%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for DL58213: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB27737%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for AB27737: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: PV43751
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: BZ32388
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: BF01952
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF01952%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for BF01952: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: GR87963
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for GR38931: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ39955%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for MZ39955: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: WZ89922
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55582%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for FG55582: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: FX73004
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX73004%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for FX73004: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for MH20468: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: CT28544
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: ZZ22411
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: BC32553
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC32553%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for BC32553: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: TR77666
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR77666%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for TR77666: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: AM57263
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: YC31452
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC31452%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for YC31452: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: UT50255
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT50255%27 HTTP/1.1" 200 None
2026-03-28 10:42:50 [auto1.de] INFO: Scrape type for UT50255: 0
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-28 10:42:50 [auto1.de] INFO: Found listing with ID: SN29778
2026-03-28 10:42:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:00 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 9649 | hits on page: 40
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: SN29778
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: FY31029
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: NW62557
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: KV92241
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV92241%27 HTTP/1.1" 200 None
2026-03-28 10:43:00 [auto1.de] INFO: Scrape type for KV92241: 0
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: VE56470
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: ZD16653
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD16653%27 HTTP/1.1" 200 None
2026-03-28 10:43:00 [auto1.de] INFO: Scrape type for ZD16653: 0
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: FL10476
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL10476%27 HTTP/1.1" 200 None
2026-03-28 10:43:00 [auto1.de] INFO: Scrape type for FL10476: 0
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: FT17472
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: HW55427
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW55427%27 HTTP/1.1" 200 None
2026-03-28 10:43:00 [auto1.de] INFO: Scrape type for HW55427: 0
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: AT91043
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: XU94698
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89318%27 HTTP/1.1" 200 None
2026-03-28 10:43:00 [auto1.de] INFO: Scrape type for HA89318: 0
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: VF29678
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF29678%27 HTTP/1.1" 200 None
2026-03-28 10:43:00 [auto1.de] INFO: Scrape type for VF29678: 0
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: TX14113
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: HU68643
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13799%27 HTTP/1.1" 200 None
2026-03-28 10:43:00 [auto1.de] INFO: Scrape type for PV13799: 0
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: SV18640
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-28 10:43:00 [auto1.de] INFO: Found listing with ID: KU76096
2026-03-28 10:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU76096%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for KU76096: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: XM76659
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD83034%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for SD83034: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: NG64881
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG64881%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for NG64881: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: WB57730
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: TD78857
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD78857%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for TD78857: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: WB68702
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB68702%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for WB68702: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: BK48500
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: TA30581
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30581%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for TA30581: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: ES90262
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: KH17356
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH17356%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for KH17356: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: KG51970
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: RT76696
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: XL57324
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL57324%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for XL57324: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: PK52215
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: SV40404
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: WH62381
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH62381%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for WH62381: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: AG00767
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG00767%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for AG00767: 0
2026-03-28 10:43:01 [auto1.de] INFO: Found listing with ID: GJ42826
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42826%27 HTTP/1.1" 200 None
2026-03-28 10:43:01 [auto1.de] INFO: Scrape type for GJ42826: 0
2026-03-28 10:43:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:06 [scrapy.extensions.logstats] INFO: Crawled 251 pages (at 6 pages/min), scraped 191 items (at 0 items/min)
2026-03-28 10:43:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:09 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:09 [auto1.de] INFO: Found listing with ID: GJ42826
2026-03-28 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42826%27 HTTP/1.1" 200 None
2026-03-28 10:43:09 [auto1.de] INFO: Scrape type for GJ42826: 0
2026-03-28 10:43:09 [auto1.de] INFO: Found listing with ID: EL91919
2026-03-28 10:43:09 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for PK45675: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: ZR88631
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: AD17341
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: DY66816
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY66816%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for DY66816: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: TS73841
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS73841%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for TS73841: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for KZ47858: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD30169%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for HD30169: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: ZR29667
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: PR18701
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR18701%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for PR18701: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: NZ20734
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ20734%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for NZ20734: 0
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: CR46932
2026-03-28 10:43:10 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-28 10:43:10 [auto1.de] INFO: Scrape type for UP49415: 2
2026-03-28 10:43:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9af7212-3b09-5068-b733-f03063527caf with identifier: UP49415
2026-03-28 10:43:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9af7212-3b09-5068-b733-f03063527caf with scrape type 2
2026-03-28 10:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9af7212-3b09-5068-b733-f03063527caf with scrape type 2
2026-03-28 10:43:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9af7212-3b09-5068-b733-f03063527caf, identifier: UP49415
2026-03-28 10:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9af7212-3b09-5068-b733-f03063527caf with identifier: UP49415
2026-03-28 10:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9af7212-3b09-5068-b733-f03063527caf with identifier: UP49415
2026-03-28 10:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9af7212-3b09-5068-b733-f03063527caf with identifier: UP49415 to the API
2026-03-28 10:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:43:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:50:20Z',
 'fuel_type': 'diesel',
 'id': 'd9af7212-3b09-5068-b733-f03063527caf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP49415',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 201758,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-22',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2014}
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Saving data for UP49415: {'auction_closing_time': 1774716620.0, 'created_time': 1773308105.866994, 'last_price_update_time': 1774694592.566084}
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP49415') HTTP/1.1" 204 0
2026-03-28 10:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81159%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for RB81159: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: GD15410
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD15410%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for GD15410: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for MZ83474: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: SU75801
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: HZ20849
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: EV62209
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV62209%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for EV62209: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: TY59388
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: LG76747
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG76747%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for LG76747: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: WL38814
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for DK33698: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: FR53329
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR53329%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for FR53329: 0
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: TB85730
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: UV62797
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-28 10:43:12 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV36392%27 HTTP/1.1" 200 None
2026-03-28 10:43:12 [auto1.de] INFO: Scrape type for SV36392: 2
2026-03-28 10:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8e2f5a1-2291-5405-a3d3-88671be8f99b with identifier: SV36392
2026-03-28 10:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8e2f5a1-2291-5405-a3d3-88671be8f99b with scrape type 2
2026-03-28 10:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8e2f5a1-2291-5405-a3d3-88671be8f99b with scrape type 2
2026-03-28 10:43:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8e2f5a1-2291-5405-a3d3-88671be8f99b, identifier: SV36392
2026-03-28 10:43:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8e2f5a1-2291-5405-a3d3-88671be8f99b with identifier: SV36392
2026-03-28 10:43:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8e2f5a1-2291-5405-a3d3-88671be8f99b with identifier: SV36392
2026-03-28 10:43:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8e2f5a1-2291-5405-a3d3-88671be8f99b with identifier: SV36392 to the API
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:43:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:17:37Z',
 'fuel_type': 'diesel',
 'id': 'f8e2f5a1-2291-5405-a3d3-88671be8f99b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV36392',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 217958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 290 L1 Trend',
 'transmission': 'manual',
 'trim': '290 L1 Trend',
 'year': 2015}
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV36392%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Saving data for SV36392: {'auction_closing_time': 1774714657.0, 'created_time': 1773304696.029236, 'last_price_update_time': 1774694593.282782}
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV36392') HTTP/1.1" 204 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU33293%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for EU33293: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: KU48323
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48323%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for KU48323: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: KY16497
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: KG98578
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: GC23604
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC23604%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for GC23604: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: PY07477
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU02094%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for LU02094: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: XH29629
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH29629%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for XH29629: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: YY96665
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY96665%27 HTTP/1.1" 200 None
2026-03-28 10:43:13 [auto1.de] INFO: Scrape type for YY96665: 0
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-28 10:43:13 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-28 10:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:16 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: LW43153
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43153%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for LW43153: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for LP76245: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: CZ59156
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: NG39570
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: DE61416
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for EG31023: 0
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-28 10:43:16 [auto1.de] INFO: Found listing with ID: TV36332
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV36332%27 HTTP/1.1" 200 None
2026-03-28 10:43:16 [auto1.de] INFO: Scrape type for TV36332: 2
2026-03-28 10:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541bedce-114b-56af-b8bd-b53b60df1acc with identifier: TV36332
2026-03-28 10:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541bedce-114b-56af-b8bd-b53b60df1acc with scrape type 2
2026-03-28 10:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541bedce-114b-56af-b8bd-b53b60df1acc with scrape type 2
2026-03-28 10:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541bedce-114b-56af-b8bd-b53b60df1acc, identifier: TV36332
2026-03-28 10:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541bedce-114b-56af-b8bd-b53b60df1acc with identifier: TV36332
2026-03-28 10:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541bedce-114b-56af-b8bd-b53b60df1acc with identifier: TV36332
2026-03-28 10:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541bedce-114b-56af-b8bd-b53b60df1acc with identifier: TV36332 to the API
2026-03-28 10:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:43:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:35:44Z',
 'fuel_type': 'diesel',
 'id': '541bedce-114b-56af-b8bd-b53b60df1acc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV36332',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 310146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2014}
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV36332%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Saving data for TV36332: {'auction_closing_time': 1774715744.0, 'created_time': 1774510541.459222, 'last_price_update_time': 1774694597.185791}
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV36332') HTTP/1.1" 204 0
2026-03-28 10:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: YS83554
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: SD07128
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: MM98410
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for VE08810: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: FL49521
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL49521%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for FL49521: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for NF88064: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for LP44310: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for HX92939: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: AC43981
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC43981%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for AC43981: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: MC69787
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC69787%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for MC69787: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: CR20682
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR20682%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for CR20682: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: NS29449
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for CL87720: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for MH03365: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for NV55096: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: AM83584
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM83584%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for AM83584: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: WK50134
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS58629%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for VS58629: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for KV33048: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: WA59157
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for HX55522: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: TH25711
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for AM43166: 0
2026-03-28 10:43:17 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX12399%27 HTTP/1.1" 200 None
2026-03-28 10:43:17 [auto1.de] INFO: Scrape type for ZX12399: 0
2026-03-28 10:43:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:26 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: TW04232
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW04232%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for TW04232: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: FV21228
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21228%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for FV21228: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for RG95107: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: LX91307
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: FG34327
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG34327%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for FG34327: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: BJ20331
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ20331%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for BJ20331: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: TX55902
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX55902%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for TX55902: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: TL28504
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: WV72742
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV72742%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for WV72742: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: BP63027
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP63027%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for BP63027: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for LB03108: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED43113%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for ED43113: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC27013%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for UC27013: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: NE71450
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: JK54144
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for GY35476: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: LU41152
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: AP94467
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP94467%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for AP94467: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: YL58691
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: TW29404
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW29404%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for TW29404: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: HY08427
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: AN50976
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: ES83380
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES83380%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for ES83380: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: WR22975
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE57105%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for VE57105: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: XB15869
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB15869%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for XB15869: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for FV65723: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: SH65641
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: AP13517
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13517%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for AP13517: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for DV26733: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: MK42970
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK42970%27 HTTP/1.1" 200 None
2026-03-28 10:43:26 [auto1.de] INFO: Scrape type for MK42970: 0
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: UA59950
2026-03-28 10:43:26 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-28 10:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:31 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: DS83303
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS83303%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for DS83303: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: SR06825
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR06825%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for SR06825: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: GC30442
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: VC88612
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC88612%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for VC88612: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for FH53485: 0
2026-03-28 10:43:31 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-28 10:43:31 [auto1.de] INFO: Scrape type for NY19608: 2
2026-03-28 10:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 521f77fb-3b1d-530f-a8ad-866b14571dce with identifier: NY19608
2026-03-28 10:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 521f77fb-3b1d-530f-a8ad-866b14571dce with scrape type 2
2026-03-28 10:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 521f77fb-3b1d-530f-a8ad-866b14571dce with scrape type 2
2026-03-28 10:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 521f77fb-3b1d-530f-a8ad-866b14571dce, identifier: NY19608
2026-03-28 10:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 521f77fb-3b1d-530f-a8ad-866b14571dce with identifier: NY19608
2026-03-28 10:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 521f77fb-3b1d-530f-a8ad-866b14571dce with identifier: NY19608
2026-03-28 10:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 521f77fb-3b1d-530f-a8ad-866b14571dce with identifier: NY19608 to the API
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:43:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:28:08Z',
 'fuel_type': 'petrol',
 'id': '521f77fb-3b1d-530f-a8ad-866b14571dce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY19608',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 4321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-06',
 'seller_name': None,
 'title': 'BMW 1er 120 Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2025}
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Saving data for NY19608: {'auction_closing_time': 1774715288.0, 'created_time': 1774510538.443023, 'last_price_update_time': 1774694612.085398}
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY19608') HTTP/1.1" 204 0
2026-03-28 10:43:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: WX33301
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX33301%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for WX33301: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: FJ03790
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ03790%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for FJ03790: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: HX25760
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX25760%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for HX25760: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for DG36538: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: VM73254
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM73254%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for VM73254: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM33807%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for AM33807: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: AN43216
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for CX50338: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: ZD44688
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD44688%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for ZD44688: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: UD17683
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17683%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for UD17683: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: XD99934
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: SD42859
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for TY49191: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: SH18397
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH18397%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for SH18397: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for XS25100: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for UK63954: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: VT99201
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: SR45801
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR45801%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for SR45801: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for NY59732: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: TS09948
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS09948%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for TS09948: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for RV14336: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for XK33490: 0
2026-03-28 10:43:32 [auto1.de] INFO: Found listing with ID: CY08035
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY08035%27 HTTP/1.1" 200 None
2026-03-28 10:43:32 [auto1.de] INFO: Scrape type for CY08035: 0
2026-03-28 10:43:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:33 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 9650 | hits on page: 40
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: MP29574
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP29574%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for MP29574: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: KB34579
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB34579%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for KB34579: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: PV96474
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV96474%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for PV96474: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: PS89246
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: XD38705
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK56908%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for FK56908: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for WN48846: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: KC05152
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: GH45156
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for VS89065: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: WG89224
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG89224%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for WG89224: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: VJ14955
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ14955%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for VJ14955: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: YU65678
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for GZ29273: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: JN35186
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN35186%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for JN35186: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: WG93037
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93037%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for WG93037: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: ZP00129
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: PZ57242
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ57242%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for PZ57242: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: WP89589
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP89589%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for WP89589: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: BW90089
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW90089%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for BW90089: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for UH95210: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: CD78722
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD78722%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for CD78722: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: AD42447
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA32858%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for SA32858: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: CP28896
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: CS85382
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS85382%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for CS85382: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: NP57126
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP57126%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for NP57126: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: CF83908
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF83908%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for CF83908: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: LS49752
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS49752%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for LS49752: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for GW15546: 0
2026-03-28 10:43:33 [auto1.de] INFO: Found listing with ID: XN63500
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN63500%27 HTTP/1.1" 200 None
2026-03-28 10:43:33 [auto1.de] INFO: Scrape type for XN63500: 0
2026-03-28 10:43:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:43:37 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 9651 | hits on page: 40
2026-03-28 10:43:37 [auto1.de] INFO: Found listing with ID: XN63500
2026-03-28 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN63500%27 HTTP/1.1" 200 None
2026-03-28 10:43:37 [auto1.de] INFO: Scrape type for XN63500: 0
2026-03-28 10:43:37 [auto1.de] INFO: Found listing with ID: WD62968
2026-03-28 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD62968%27 HTTP/1.1" 200 None
2026-03-28 10:43:37 [auto1.de] INFO: Scrape type for WD62968: 0
2026-03-28 10:43:37 [auto1.de] INFO: Found listing with ID: SA60451
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA60451%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for SA60451: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: EW58649
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW58649%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for EW58649: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: MS64258
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: GZ76371
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76371%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for GZ76371: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: TP46996
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: AK23764
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: NM87427
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM87427%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for NM87427: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: ST39834
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: RF93551
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: XV50693
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: DM54367
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: PX20258
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for FH60355: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT79554%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for RT79554: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: RT19739
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for ER72643: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: CH35600
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH35600%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for CH35600: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: JP66680
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP66680%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for JP66680: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for XS93446: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for TR76591: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: EK02801
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK02801%27 HTTP/1.1" 200 None
2026-03-28 10:43:38 [auto1.de] INFO: Scrape type for EK02801: 0
2026-03-28 10:43:38 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-28 10:43:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:06 [scrapy.extensions.logstats] INFO: Crawled 257 pages (at 6 pages/min), scraped 195 items (at 4 items/min)
2026-03-28 10:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:44:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:10 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 9652 | hits on page: 40
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: DH11465
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH11465%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for DH11465: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: CA94630
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA94630%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for CA94630: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: RL76868
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: ED51510
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED51510%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for ED51510: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: MA62044
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: XE97830
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE97830%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for XE97830: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: CS95663
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: AJ19988
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ19988%27 HTTP/1.1" 200 None
2026-03-28 10:44:10 [auto1.de] INFO: Scrape type for AJ19988: 0
2026-03-28 10:44:10 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for UN86111: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: LT67236
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: PP02879
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP02879%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for PP02879: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: HE75386
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE75386%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for HE75386: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: MK06365
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK06365%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for MK06365: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for TR13972: 2
2026-03-28 10:44:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972
2026-03-28 10:44:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55562edd-05c9-53a6-8b99-5d825810cd48 with scrape type 2
2026-03-28 10:44:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55562edd-05c9-53a6-8b99-5d825810cd48 with scrape type 2
2026-03-28 10:44:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55562edd-05c9-53a6-8b99-5d825810cd48, identifier: TR13972
2026-03-28 10:44:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972
2026-03-28 10:44:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972
2026-03-28 10:44:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55562edd-05c9-53a6-8b99-5d825810cd48 with identifier: TR13972 to the API
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-28T16:02:11Z',
 'fuel_type': 'petrol',
 'id': '55562edd-05c9-53a6-8b99-5d825810cd48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR13972',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'S-TYPE',
 'odometer': 192016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-08-26',
 'seller_name': None,
 'title': 'Jaguar S-TYPE 3.0 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 1999}
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Saving data for TR13972: {'auction_closing_time': 1774713731.0, 'created_time': 1774510537.288954, 'last_price_update_time': 1774694651.827586}
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR13972') HTTP/1.1" 204 0
2026-03-28 10:44:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: HV42647
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV42647%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for HV42647: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: PA83352
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: WR71017
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR71017%27 HTTP/1.1" 200 None
2026-03-28 10:44:11 [auto1.de] INFO: Scrape type for WR71017: 0
2026-03-28 10:44:11 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-28 10:44:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for EZ35619: 2
2026-03-28 10:44:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e70f468-a440-5235-a96b-113d396091c2 with identifier: EZ35619
2026-03-28 10:44:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e70f468-a440-5235-a96b-113d396091c2 with scrape type 2
2026-03-28 10:44:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e70f468-a440-5235-a96b-113d396091c2 with scrape type 2
2026-03-28 10:44:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e70f468-a440-5235-a96b-113d396091c2, identifier: EZ35619
2026-03-28 10:44:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e70f468-a440-5235-a96b-113d396091c2 with identifier: EZ35619
2026-03-28 10:44:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e70f468-a440-5235-a96b-113d396091c2 with identifier: EZ35619
2026-03-28 10:44:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e70f468-a440-5235-a96b-113d396091c2 with identifier: EZ35619 to the API
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:48:31Z',
 'fuel_type': 'petrol',
 'id': '4e70f468-a440-5235-a96b-113d396091c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ35619',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 164611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-10',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Saving data for EZ35619: {'auction_closing_time': 1774716511.0, 'created_time': 1774510543.754366, 'last_price_update_time': 1774694652.432283}
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ35619') HTTP/1.1" 204 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: JG22521
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG22521%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for JG22521: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: CS66629
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS66629%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for CS66629: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: TH58497
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH58497%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for TH58497: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: XV43778
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV43778%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for XV43778: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: PX36804
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: PW66424
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for FX01006: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: VF30543
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: LE20823
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE20823%27 HTTP/1.1" 200 None
2026-03-28 10:44:12 [auto1.de] INFO: Scrape type for LE20823: 0
2026-03-28 10:44:12 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-28 10:44:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:13 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU52502%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for XU52502: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC43616%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for NC43616: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for WA42384: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: MM41381
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for DW77915: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: JD69912
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: LB51000
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB51000%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for LB51000: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: DH10709
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: KF96616
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for MS83797: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: EZ29207
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: AJ30359
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: TF26845
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26845%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for TF26845: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: FR49421
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: XE20875
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE20875%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for XE20875: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: HE95422
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95422%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for HE95422: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: FL47412
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL47412%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for FL47412: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: KV09171
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: EC82787
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC82787%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for EC82787: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: RD70128
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: AN49564
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN49564%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for AN49564: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: SV38598
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: XJ09015
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64041%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for SJ64041: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: ZC73277
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC73277%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for ZC73277: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: FL25481
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL25481%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for FL25481: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for BS60844: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: ZC73485
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-28 10:44:13 [auto1.de] INFO: Scrape type for XC67226: 0
2026-03-28 10:44:13 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-28 10:44:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Scrape type for PN60983: 2
2026-03-28 10:44:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d074fd29-ff5d-58e4-9289-94b1e0fd9295 with identifier: PN60983
2026-03-28 10:44:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d074fd29-ff5d-58e4-9289-94b1e0fd9295 with scrape type 2
2026-03-28 10:44:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d074fd29-ff5d-58e4-9289-94b1e0fd9295 with scrape type 2
2026-03-28 10:44:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d074fd29-ff5d-58e4-9289-94b1e0fd9295, identifier: PN60983
2026-03-28 10:44:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d074fd29-ff5d-58e4-9289-94b1e0fd9295 with identifier: PN60983
2026-03-28 10:44:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d074fd29-ff5d-58e4-9289-94b1e0fd9295 with identifier: PN60983
2026-03-28 10:44:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d074fd29-ff5d-58e4-9289-94b1e0fd9295 with identifier: PN60983 to the API
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:33:45Z',
 'fuel_type': 'diesel',
 'id': 'd074fd29-ff5d-58e4-9289-94b1e0fd9295',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN60983',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 220890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-06',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI kompakt BlueEfficiency Trend Edition',
 'transmission': 'automatic',
 'trim': 'kompakt BlueEfficiency Trend Edition',
 'year': 2012}
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-28 10:44:14 [auto1.de] INFO: Saving data for PN60983: {'auction_closing_time': 1774715625.0, 'created_time': 1774510533.833887, 'last_price_update_time': 1774694654.499014}
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN60983') HTTP/1.1" 204 0
2026-03-28 10:44:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:14 [auto1.de] INFO: Found listing with ID: HZ37968
2026-03-28 10:44:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:15 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: AB21758
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: EX42379
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: MN42174
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for HS09512: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: VR15853
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR15853%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for VR15853: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: UY94864
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY94864%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for UY94864: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: AP00177
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP00177%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for AP00177: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: AV59132
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: WN98613
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98613%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for WN98613: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for LK47364: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: MS42171
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS42171%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for MS42171: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: GS07550
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS07550%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for GS07550: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: WU35652
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU35652%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for WU35652: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: NT94381
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: CK72775
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: YN98514
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: AZ27432
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: FZ54460
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: NC47913
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: KD46198
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD46198%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for KD46198: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: FC08101
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: BM71069
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71069%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for BM71069: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: CK18909
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: WW83643
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: FU32442
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: HP04846
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-28 10:44:15 [auto1.de] INFO: Scrape type for EL67777: 0
2026-03-28 10:44:15 [auto1.de] INFO: Found listing with ID: MP71247
2026-03-28 10:44:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71247%27 HTTP/1.1" 200 None
2026-03-28 10:44:16 [auto1.de] INFO: Scrape type for MP71247: 0
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: SA48353
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: ET75266
2026-03-28 10:44:16 [auto1.de] INFO: Found listing with ID: YX64853
2026-03-28 10:44:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:17 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: TS72437
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS72437%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for TS72437: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: KB41878
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB41878%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for KB41878: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: NB19149
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: NM18841
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for EB09552: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: BA95862
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95862%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for BA95862: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF39485%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for XF39485: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: FH78199
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: NG85198
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: ZC45709
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for WZ32773: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: ZL42149
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: AB54193
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: AN39214
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for EX27277: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL07964%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for TL07964: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: HZ35623
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35623%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for HZ35623: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: AV36949
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV36949%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for AV36949: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: HE50023
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for HC69827: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for KW68340: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for UK52286: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: ML58643
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML58643%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for ML58643: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: XU25249
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU25249%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for XU25249: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: NF91521
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91521%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for NF91521: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: WD57497
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: VR97346
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR97346%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for VR97346: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: NZ77836
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: RH08953
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: KS00518
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: JP67472
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP67472%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for JP67472: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: TS09067
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: ES63389
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-28 10:44:17 [auto1.de] INFO: Scrape type for YT31718: 0
2026-03-28 10:44:17 [auto1.de] INFO: Found listing with ID: SH15635
2026-03-28 10:44:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:18 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: XJ09013
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: HX06871
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG89372%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for NG89372: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13854%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for EA13854: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: BJ62941
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: ZR46884
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: YP80343
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for ZA93244: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: AB71807
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB71807%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for AB71807: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: CW94912
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW94912%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for CW94912: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: GL98026
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL98026%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for GL98026: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: TH04354
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: GZ39772
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ39772%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for GZ39772: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for TD61700: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-28 10:44:18 [auto1.de] INFO: Scrape type for CZ36938: 0
2026-03-28 10:44:18 [auto1.de] INFO: Found listing with ID: RB04302
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB04302%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for RB04302: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: JR64740
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: UX27196
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: DY53680
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY53680%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for DY53680: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: XU08667
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU08667%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for XU08667: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for WD16900: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: SM94755
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: RA48340
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA48340%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for RA48340: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: LM34765
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: GS63097
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS63097%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for GS63097: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU85949%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for AU85949: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: AP70373
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP70373%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for AP70373: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: DC45609
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: FK07385
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: ZJ58005
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: NE18994
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE18994%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for NE18994: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: WT90781
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT90781%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for WT90781: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: SE64605
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-28 10:44:19 [auto1.de] INFO: Scrape type for UR14264: 0
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-28 10:44:19 [auto1.de] INFO: Found listing with ID: FJ58428
2026-03-28 10:44:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:20 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for RP43844: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for TW15848: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: TS91087
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS91087%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for TS91087: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: CS76410
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for FC74080: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: RZ52182
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52182%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for RZ52182: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for FT31566: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: LU79813
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU79813%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for LU79813: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: NV48400
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48400%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for NV48400: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW06930%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for EW06930: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: RX22945
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22945%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for RX22945: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: EN59108
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98775%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for ST98775: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: VF93957
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF93957%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for VF93957: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: EW00282
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW00282%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for EW00282: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: ZV14288
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: UR69038
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR69038%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for UR69038: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: VK29139
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for DW05211: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: KZ84912
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ84912%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for KZ84912: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: CR80817
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: CF81636
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF81636%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for CF81636: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: GD73586
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD73586%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for GD73586: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: FA74860
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA74860%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for FA74860: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26744%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for GB26744: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: RV71441
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV71441%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for RV71441: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: PR29926
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR29926%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for PR29926: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: BV83779
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV83779%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for BV83779: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: FA89686
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA89686%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for FA89686: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for KB32538: 0
2026-03-28 10:44:20 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-28 10:44:20 [auto1.de] INFO: Scrape type for CF22867: 0
2026-03-28 10:44:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:22 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:22 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-28 10:44:22 [auto1.de] INFO: Scrape type for VL77051: 0
2026-03-28 10:44:22 [auto1.de] INFO: Found listing with ID: MZ57576
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ57576%27 HTTP/1.1" 200 None
2026-03-28 10:44:22 [auto1.de] INFO: Scrape type for MZ57576: 0
2026-03-28 10:44:22 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-28 10:44:22 [auto1.de] INFO: Scrape type for LN58071: 0
2026-03-28 10:44:22 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ60723%27 HTTP/1.1" 200 None
2026-03-28 10:44:22 [auto1.de] INFO: Scrape type for MZ60723: 0
2026-03-28 10:44:22 [auto1.de] INFO: Found listing with ID: DU90887
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU90887%27 HTTP/1.1" 200 None
2026-03-28 10:44:22 [auto1.de] INFO: Scrape type for DU90887: 0
2026-03-28 10:44:22 [auto1.de] INFO: Found listing with ID: NB32533
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB32533%27 HTTP/1.1" 200 None
2026-03-28 10:44:22 [auto1.de] INFO: Scrape type for NB32533: 0
2026-03-28 10:44:22 [auto1.de] INFO: Found listing with ID: LR77482
2026-03-28 10:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR77482%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for LR77482: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: TY77956
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: NC83571
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC83571%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for NC83571: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: MA82889
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA82889%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for MA82889: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: EG84867
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for VN62534: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: FA82480
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA82480%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for FA82480: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98160%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for ZR98160: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: TS72146
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS72146%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for TS72146: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: HY62017
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: NN85060
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: WG82326
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for GL61912: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: SB50854
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: JC70183
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: WS56575
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for WS31989: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: XT08306
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: LS92579
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: AD32766
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: RJ41827
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: XS15243
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS15243%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for XS15243: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: KH60913
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: SD51082
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD51082%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for SD51082: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-28 10:44:23 [auto1.de] INFO: Scrape type for RS40485: 0
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: GC08040
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: VP92353
2026-03-28 10:44:23 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-28 10:44:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:27 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: XU27440
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU27440%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for XU27440: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: ZW69442
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW69442%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for ZW69442: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: GG79095
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: ZV46118
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: XJ72982
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ72982%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for XJ72982: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: LX72474
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX72474%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for LX72474: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: VU02651
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU02651%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for VU02651: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB39806%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for XB39806: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for DV89701: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: ZS42305
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS42305%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for ZS42305: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: NF12246
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12246%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for NF12246: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: RS99660
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: LW97378
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW97378%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for LW97378: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: KP56505
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for BW78905: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: JL26666
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: AL43539
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: LT28781
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT28781%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for LT28781: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: RW46423
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for VJ57746: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: NP20797
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP20797%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for NP20797: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31529%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for VL31529: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: RE78828
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: VX80468
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX80468%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for VX80468: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: LF99231
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF99231%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for LF99231: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for FN01227: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: YE53774
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: YH42279
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH42279%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for YH42279: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: US02373
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: UP47374
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP47374%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for UP47374: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: PS14610
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS14610%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for PS14610: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for AH65486: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: SL60140
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: RC15993
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: NF90345
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for AG84988: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: SD48131
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD48131%27 HTTP/1.1" 200 None
2026-03-28 10:44:27 [auto1.de] INFO: Scrape type for SD48131: 0
2026-03-28 10:44:27 [auto1.de] INFO: Found listing with ID: NR21254
2026-03-28 10:44:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:30 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:30 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-28 10:44:30 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-28 10:44:30 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-28 10:44:30 [auto1.de] INFO: Found listing with ID: VH89235
2026-03-28 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH89235%27 HTTP/1.1" 200 None
2026-03-28 10:44:30 [auto1.de] INFO: Scrape type for VH89235: 2
2026-03-28 10:44:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad228d91-466e-5f9f-8cf4-71b329796b9c with identifier: VH89235
2026-03-28 10:44:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad228d91-466e-5f9f-8cf4-71b329796b9c with scrape type 2
2026-03-28 10:44:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad228d91-466e-5f9f-8cf4-71b329796b9c with scrape type 2
2026-03-28 10:44:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad228d91-466e-5f9f-8cf4-71b329796b9c, identifier: VH89235
2026-03-28 10:44:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad228d91-466e-5f9f-8cf4-71b329796b9c with identifier: VH89235
2026-03-28 10:44:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad228d91-466e-5f9f-8cf4-71b329796b9c with identifier: VH89235
2026-03-28 10:44:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad228d91-466e-5f9f-8cf4-71b329796b9c with identifier: VH89235 to the API
2026-03-28 10:44:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:26:21Z',
 'fuel_type': 'hybrid',
 'id': 'ad228d91-466e-5f9f-8cf4-71b329796b9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH89235',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris Cross',
 'odometer': 120967,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-17',
 'seller_name': None,
 'title': 'Toyota Yaris Cross 1.5 Hybrid 2WD Adventure',
 'transmission': 'automatic',
 'trim': '2WD Adventure',
 'year': 2022}
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH89235%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Saving data for VH89235: {'auction_closing_time': 1774715181.0, 'created_time': 1774378279.234469, 'last_price_update_time': 1774694672.166405}
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH89235') HTTP/1.1" 204 0
2026-03-28 10:44:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: LU81602
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU81602%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for LU81602: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: NR78378
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: MR59336
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for SX85367: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: RM29704
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM29704%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for RM29704: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: DF78416
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF78416%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for DF78416: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13190%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for TU13190: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: ZU61173
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: NP44902
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: UX06727
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: UE16674
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE16674%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for UE16674: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF21402%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for PF21402: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for FJ09626: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: DB02068
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for RW82332: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55762%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for LV55762: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: DN90837
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: DC86459
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: GX87234
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: FD35505
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for VK80269: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for HW43883: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX06129%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for JX06129: 0
2026-03-28 10:44:32 [auto1.de] INFO: Found listing with ID: CF23775
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF23775%27 HTTP/1.1" 200 None
2026-03-28 10:44:32 [auto1.de] INFO: Scrape type for CF23775: 0
2026-03-28 10:44:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:34 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: AC62471
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: LJ59261
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ59261%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for LJ59261: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: HR49435
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM14245%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for EM14245: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: NF21329
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: ZJ77365
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: GB55666
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for UY21095: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: UK10359
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK10359%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for UK10359: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: NY96268
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: HX46872
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX46872%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for HX46872: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: DE17947
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE17947%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for DE17947: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for XN65057: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: VM56295
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: RR66654
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: RW07323
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW07323%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for RW07323: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for JR00588: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: AE93304
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93304%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for AE93304: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for KD53590: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: PM54102
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for YR25980: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: DS40784
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS40784%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for DS40784: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: GE94573
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: KJ26847
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: AN17735
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: NE28687
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE28687%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for NE28687: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: JT80939
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for KU48054: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: DM27064
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27064%27 HTTP/1.1" 200 None
2026-03-28 10:44:34 [auto1.de] INFO: Scrape type for DM27064: 0
2026-03-28 10:44:34 [auto1.de] INFO: Found listing with ID: AK06166
2026-03-28 10:44:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:40 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: RD74576
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: KN88175
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: MV92075
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92075%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for MV92075: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: LC82989
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: DL83760
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: VK16260
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: NT22490
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: ZX04970
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: KN35431
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: JM96313
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM96313%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for JM96313: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: UX25395
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX25395%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for UX25395: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: AS81057
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS81057%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for AS81057: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for XA15787: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: DL24086
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: LS75828
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75828%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for LS75828: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: NX05955
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX05955%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for NX05955: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: PJ28903
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for VJ43142: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: KN21474
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN21474%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for KN21474: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: ZL05657
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL05657%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for ZL05657: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for BX19940: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: YH51203
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH51203%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for YH51203: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: VR19710
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR19710%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for VR19710: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: XJ13626
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for SX22441: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: VL76600
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL76600%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for VL76600: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: CR93470
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: FK98108
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: LB19367
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB19367%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for LB19367: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24808%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for UG24808: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: ZM18653
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM18653%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for ZM18653: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for WV85362: 0
2026-03-28 10:44:40 [auto1.de] INFO: Found listing with ID: MR24892
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR24892%27 HTTP/1.1" 200 None
2026-03-28 10:44:40 [auto1.de] INFO: Scrape type for MR24892: 0
2026-03-28 10:44:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:42 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: KL40189
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL40189%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for KL40189: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: YS87471
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: EJ76475
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: LL66986
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL66986%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for LL66986: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: UD68347
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD68347%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for UD68347: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: XE71423
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: GV75599
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV75599%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for GV75599: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE69699%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for UE69699: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60754%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for AN60754: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: YT66272
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT66272%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for YT66272: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: MK96538
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK96538%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for MK96538: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: DB03654
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB03654%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for DB03654: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for HN24396: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: KL31519
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31519%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for KL31519: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: AY28505
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE25074%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for DE25074: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: RU14902
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU14902%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for RU14902: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for LJ39551: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL34122%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for FL34122: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: WT95105
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: RX16022
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX16022%27 HTTP/1.1" 200 None
2026-03-28 10:44:42 [auto1.de] INFO: Scrape type for RX16022: 0
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-28 10:44:42 [auto1.de] INFO: Found listing with ID: YT74468
2026-03-28 10:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT74468%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for YT74468: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: KA35826
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: RN29221
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX90434%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for VX90434: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: XV23695
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV23695%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for XV23695: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: JW40764
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: LM46522
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: YN88329
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: KA32583
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA32583%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for KA32583: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for BX26482: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: YE96502
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE96502%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for YE96502: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: ZW02435
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW02435%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for ZW02435: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: CS43152
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS43152%27 HTTP/1.1" 200 None
2026-03-28 10:44:43 [auto1.de] INFO: Scrape type for CS43152: 0
2026-03-28 10:44:43 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-28 10:44:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:44 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: SX08307
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for SD32112: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: WW55447
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: XJ15035
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: JF53186
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF53186%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for JF53186: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: CU82641
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU82641%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for CU82641: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: GN50341
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: AG19353
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG19353%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for AG19353: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: XH14540
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: CL78510
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL78510%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for CL78510: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: MH03153
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: FN85811
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85811%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for FN85811: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: TR50455
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR50455%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for TR50455: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: RL02084
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92494%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for MV92494: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: JK78478
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK78478%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for JK78478: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: NX06422
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX06422%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for NX06422: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: ZG25746
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: TA71788
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: BY41560
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY41560%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for BY41560: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: MR54336
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR54336%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for MR54336: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL40632%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for CL40632: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: VR71281
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: PB95910
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB95910%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for PB95910: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: YJ24873
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ24873%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for YJ24873: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: AP99471
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP99471%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for AP99471: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: FN87515
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: WX25953
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: RL49502
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: PG02615
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG02615%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for PG02615: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: VR30275
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR30275%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for VR30275: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: GC30082
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30082%27 HTTP/1.1" 200 None
2026-03-28 10:44:44 [auto1.de] INFO: Scrape type for GC30082: 0
2026-03-28 10:44:44 [auto1.de] INFO: Found listing with ID: AH51648
2026-03-28 10:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:45 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 9653 | hits on page: 40
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: SK62932
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK62932%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for SK62932: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: BM74248
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM74248%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for BM74248: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU59517%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for WU59517: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: ZD07127
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for WH84573: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: SR89138
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR89138%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for SR89138: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for WA89012: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: HW40680
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: JM30050
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM30050%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for JM30050: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: CJ89630
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ89630%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for CJ89630: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM64478%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for AM64478: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: BY97768
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: UB98859
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: MY96813
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY96813%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for MY96813: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for RD80564: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: NB75703
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: RY65536
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for UZ04747: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for CW72943: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: KC84563
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC84563%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for KC84563: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: RA53800
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA53800%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for RA53800: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: TK31423
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: CN66331
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: XR50139
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: KT16474
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT16474%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for KT16474: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: GE45288
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE45288%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for GE45288: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for HU68423: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for SW13301: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU66110%27 HTTP/1.1" 200 None
2026-03-28 10:44:45 [auto1.de] INFO: Scrape type for GU66110: 0
2026-03-28 10:44:45 [auto1.de] INFO: Found listing with ID: PP17491
2026-03-28 10:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP17491%27 HTTP/1.1" 200 None
2026-03-28 10:44:46 [auto1.de] INFO: Scrape type for PP17491: 2
2026-03-28 10:44:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with identifier: PP17491
2026-03-28 10:44:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with scrape type 2
2026-03-28 10:44:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with scrape type 2
2026-03-28 10:44:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f66ab99-b7d8-5d20-98fe-da101f6e5044, identifier: PP17491
2026-03-28 10:44:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with identifier: PP17491
2026-03-28 10:44:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with identifier: PP17491
2026-03-28 10:44:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f66ab99-b7d8-5d20-98fe-da101f6e5044 with identifier: PP17491 to the API
2026-03-28 10:44:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:44:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:21:30Z',
 'fuel_type': 'diesel',
 'id': '9f66ab99-b7d8-5d20-98fe-da101f6e5044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP17491',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 259644,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-01',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Style BlueMotion',
 'year': 2012}
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP17491%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Saving data for PP17491: {'auction_closing_time': 1774714890.0, 'created_time': 1774293128.76518, 'last_price_update_time': 1774694688.065188}
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP17491') HTTP/1.1" 204 0
2026-03-28 10:44:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: JJ86337
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for KG76209: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: LD43960
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD43960%27 HTTP/1.1" 200 None
2026-03-28 10:44:48 [auto1.de] INFO: Scrape type for LD43960: 0
2026-03-28 10:44:48 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-28 10:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:44:49 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 9654 | hits on page: 40
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for KH49369: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: EW55752
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: DB79259
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB79259%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for DB79259: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: GA76856
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA76856%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for GA76856: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH48180%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for PH48180: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: KZ06018
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ06018%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for KZ06018: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35466%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for RD35466: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: LC81158
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC81158%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for LC81158: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for RD90003: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: VY77073
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY77073%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for VY77073: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: ZK29969
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29969%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for ZK29969: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: RF30152
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: ZS59678
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: NC92529
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG78657%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for CG78657: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: SC50732
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC50732%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for SC50732: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: KP41876
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV13612%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for AV13612: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: EF37274
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: KR19080
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR19080%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for KR19080: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD52714%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for GD52714: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA14077%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for KA14077: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: KG91640
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: KM15369
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM15369%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for KM15369: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: VA30007
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: RG19344
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: NZ71829
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ71829%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for NZ71829: 0
2026-03-28 10:44:49 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:44:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH25486%27 HTTP/1.1" 200 None
2026-03-28 10:44:49 [auto1.de] INFO: Scrape type for PH25486: 0
2026-03-28 10:44:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:00 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 9654 | hits on page: 40
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: YX52841
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX52841%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for YX52841: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for KF79768: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: AW04202
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW04202%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for AW04202: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: LS62630
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS62630%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for LS62630: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: GY70112
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: LP56741
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: HD75435
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD75435%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for HD75435: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: BG54710
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: YF10797
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF08436%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for ZF08436: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: ZK63444
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK63444%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for ZK63444: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for VZ53815: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: VX88052
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: KZ16739
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16739%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for KZ16739: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: EE36911
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE36911%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for EE36911: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: SS03319
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS03319%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for SS03319: 0
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: YW70204
2026-03-28 10:45:00 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-28 10:45:00 [auto1.de] INFO: Scrape type for FD80734: 2
2026-03-28 10:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with identifier: FD80734
2026-03-28 10:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with scrape type 2
2026-03-28 10:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with scrape type 2
2026-03-28 10:45:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb, identifier: FD80734
2026-03-28 10:45:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with identifier: FD80734
2026-03-28 10:45:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with identifier: FD80734
2026-03-28 10:45:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb with identifier: FD80734 to the API
2026-03-28 10:45:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:45:47Z',
 'fuel_type': 'diesel',
 'id': 'f1bacb28-ef92-5a6c-8fa3-3d27e28c2eeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD80734',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 49060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-12',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'manual',
 'trim': 'Kasten FWD',
 'year': 2022}
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Saving data for FD80734: {'auction_closing_time': 1774716347.0, 'created_time': 1773301995.11854, 'last_price_update_time': 1774694702.44994}
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD80734') HTTP/1.1" 204 0
2026-03-28 10:45:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: UH98030
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: BS27408
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: VX44094
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX44094%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for VX44094: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for AC92366: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU01908%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for ZU01908: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: XV69460
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: LW52263
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for MZ37789: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: ER58682
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER58682%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for ER58682: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: CV14435
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV14435%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for CV14435: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: BZ25882
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ25882%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for BZ25882: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: DA66634
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: LK13966
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK13966%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for LK13966: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: UM70587
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM70587%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for UM70587: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: UM02167
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM02167%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for UM02167: 0
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-28 10:45:02 [auto1.de] INFO: Found listing with ID: SX00358
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX00358%27 HTTP/1.1" 200 None
2026-03-28 10:45:02 [auto1.de] INFO: Scrape type for SX00358: 0
2026-03-28 10:45:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:03 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: SX00358
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX00358%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for SX00358: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: FT33295
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT33295%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for FT33295: 0
2026-03-28 10:45:03 [auto1.de] INFO: Found listing with ID: HC21911
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC21911%27 HTTP/1.1" 200 None
2026-03-28 10:45:03 [auto1.de] INFO: Scrape type for HC21911: 2
2026-03-28 10:45:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db49da57-7701-5b39-94e8-46687329f20a with identifier: HC21911
2026-03-28 10:45:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db49da57-7701-5b39-94e8-46687329f20a with scrape type 2
2026-03-28 10:45:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db49da57-7701-5b39-94e8-46687329f20a with scrape type 2
2026-03-28 10:45:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db49da57-7701-5b39-94e8-46687329f20a, identifier: HC21911
2026-03-28 10:45:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db49da57-7701-5b39-94e8-46687329f20a with identifier: HC21911
2026-03-28 10:45:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db49da57-7701-5b39-94e8-46687329f20a with identifier: HC21911
2026-03-28 10:45:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db49da57-7701-5b39-94e8-46687329f20a with identifier: HC21911 to the API
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:07:31Z',
 'fuel_type': 'diesel',
 'id': 'db49da57-7701-5b39-94e8-46687329f20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC21911',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 338880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC21911%27 HTTP/1.1" 200 None
2026-03-28 10:45:04 [auto1.de] INFO: Saving data for HC21911: {'auction_closing_time': 1774714051.0, 'created_time': 1773344627.9428, 'last_price_update_time': 1774694704.951208}
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC21911') HTTP/1.1" 204 0
2026-03-28 10:45:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: RX96869
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX96869%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for RX96869: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM84276%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for KM84276: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for PP83297: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: PB88478
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: UU13663
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for ZD70727: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: WA83866
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: HH92077
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW60751%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for YW60751: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: YX62865
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for WR55651: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: ZZ55407
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for HU93536: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: JL97889
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ47162%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for EZ47162: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: YU02845
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: WR22738
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: GP74205
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: VM58526
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: BB20772
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20772%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for BB20772: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: VM18539
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: XS27147
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27147%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for XS27147: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: EC94378
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC94378%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for EC94378: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for YZ02891: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: XH17587
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH17587%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for XH17587: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: LV13893
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV13893%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for LV13893: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for ZE28536: 0
2026-03-28 10:45:05 [auto1.de] INFO: Found listing with ID: TW48266
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW48266%27 HTTP/1.1" 200 None
2026-03-28 10:45:05 [auto1.de] INFO: Scrape type for TW48266: 0
2026-03-28 10:45:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:06 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: VD19209
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD19209%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for VD19209: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: LB34489
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB34489%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for LB34489: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for FZ98450: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: TR39575
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: KN16725
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: VG22858
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG22858%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for VG22858: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: ZK19786
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: JM85963
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM85963%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for JM85963: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: EW45766
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW45766%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for EW45766: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: LC48893
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: SD14498
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: KP50687
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for MG33600: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: LS78763
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS78763%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for LS78763: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for MU83359: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for JD54519: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: AR17356
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR17356%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for AR17356: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: NS95449
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS95449%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for NS95449: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: SP79690
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP79690%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for SP79690: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: JP42070
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP42070%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for JP42070: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89563%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for ZT89563: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for ET23804: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: BN99234
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: ZA57423
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35504%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for WJ35504: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: JB09111
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB09111%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for JB09111: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: PG10773
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG10773%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for PG10773: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for JH61376: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: UH76939
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH76939%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for UH76939: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS56228%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for LS56228: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for VS98384: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: TB55378
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB55378%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for TB55378: 0
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-28 10:45:06 [auto1.de] INFO: Found listing with ID: AP01052
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP01052%27 HTTP/1.1" 200 None
2026-03-28 10:45:06 [auto1.de] INFO: Scrape type for AP01052: 0
2026-03-28 10:45:06 [scrapy.extensions.logstats] INFO: Crawled 275 pages (at 18 pages/min), scraped 202 items (at 7 items/min)
2026-03-28 10:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:07 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: UF45405
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR03491%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for XR03491: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: UE89498
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: JP65265
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP65265%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for JP65265: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: ET53588
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET53588%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for ET53588: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: NP60172
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP60172%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for NP60172: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: TT75700
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT75700%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for TT75700: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for EH96711: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: JP09068
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for HA98993: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for WN68055: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for UA56207: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for DA12198: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for NX98723: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for MM33078: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: SU92551
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: EG23428
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for GT81151: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: DZ63993
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: AV28159
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: DH11736
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: HB39069
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: FH49394
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02810%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for WF02810: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: EY31164
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY31164%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for EY31164: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: DM27402
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27402%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for DM27402: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU80975%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for BU80975: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS80830%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for RS80830: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: VH72276
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: EF16593
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF16593%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for EF16593: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: DC86384
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC86384%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for DC86384: 0
2026-03-28 10:45:07 [auto1.de] INFO: Found listing with ID: XL03429
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL03429%27 HTTP/1.1" 200 None
2026-03-28 10:45:07 [auto1.de] INFO: Scrape type for XL03429: 0
2026-03-28 10:45:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:08 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: ME80175
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME80175%27 HTTP/1.1" 200 None
2026-03-28 10:45:08 [auto1.de] INFO: Scrape type for ME80175: 0
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-28 10:45:08 [auto1.de] INFO: Scrape type for MM33465: 0
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: LJ19691
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: UK33318
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: GD09618
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD09618%27 HTTP/1.1" 200 None
2026-03-28 10:45:08 [auto1.de] INFO: Scrape type for GD09618: 0
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: LU10384
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: SW55555
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: DX64051
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: GC11554
2026-03-28 10:45:08 [auto1.de] INFO: Found listing with ID: DG73763
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73763%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for DG73763: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: DM75800
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM75800%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for DM75800: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: LK91672
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: DM27876
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for WY50003: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for VZ47534: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: JV13466
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: CA25135
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: XJ03116
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ03116%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for XJ03116: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: GJ22872
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ22872%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for GJ22872: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: LY83688
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY83688%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for LY83688: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: AU11749
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for WK97473: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: BP97847
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for XD31530: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: UU08337
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU08337%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for UU08337: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for ZK10618: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: AW77677
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: JS18572
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: JD92059
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: BU22697
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU22697%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for BU22697: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: KX87155
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX87155%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for KX87155: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: BC57844
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC57844%27 HTTP/1.1" 200 None
2026-03-28 10:45:09 [auto1.de] INFO: Scrape type for BC57844: 0
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-28 10:45:09 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-28 10:45:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:10 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 9655 | hits on page: 40
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF37611%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for VF37611: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: UN81742
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: MN62628
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN62628%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for MN62628: 0
2026-03-28 10:45:10 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU15284%27 HTTP/1.1" 200 None
2026-03-28 10:45:10 [auto1.de] INFO: Scrape type for ZU15284: 2
2026-03-28 10:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b060d60-9610-5aa4-b03d-34fd72987755 with identifier: ZU15284
2026-03-28 10:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b060d60-9610-5aa4-b03d-34fd72987755 with scrape type 2
2026-03-28 10:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b060d60-9610-5aa4-b03d-34fd72987755 with scrape type 2
2026-03-28 10:45:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b060d60-9610-5aa4-b03d-34fd72987755, identifier: ZU15284
2026-03-28 10:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b060d60-9610-5aa4-b03d-34fd72987755 with identifier: ZU15284
2026-03-28 10:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b060d60-9610-5aa4-b03d-34fd72987755 with identifier: ZU15284
2026-03-28 10:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b060d60-9610-5aa4-b03d-34fd72987755 with identifier: ZU15284 to the API
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:42:56Z',
 'fuel_type': 'petrol',
 'id': '7b060d60-9610-5aa4-b03d-34fd72987755',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU15284',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 199299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-25',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2008}
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU15284%27 HTTP/1.1" 200 None
2026-03-28 10:45:11 [auto1.de] INFO: Saving data for ZU15284: {'auction_closing_time': 1774716176.0, 'created_time': 1773131971.989757, 'last_price_update_time': 1774694711.910659}
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU15284') HTTP/1.1" 204 0
2026-03-28 10:45:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: ZH11790
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH11790%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for ZH11790: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: AB79624
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: XE56865
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE56865%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for XE56865: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for AG24612: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: VC92798
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: JZ81394
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ81394%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for JZ81394: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for XL13857: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for HP37567: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: YN46054
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN46054%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for YN46054: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: ZA81194
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA81194%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for ZA81194: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: PL31001
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL31001%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for PL31001: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: RU30790
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU30790%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for RU30790: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF49404%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for XF49404: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: SK57616
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: FH08441
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV26171%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for PV26171: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: PB92040
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB92040%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for PB92040: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for LP86406: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for FN16508: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for AS18464: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for HY48346: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for JZ38471: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: MV92470
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92470%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for MV92470: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: VW23219
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW23219%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for VW23219: 0
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: TN75370
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: GD02495
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: ZR68100
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: YZ46630
2026-03-28 10:45:12 [auto1.de] INFO: Found listing with ID: ZU43867
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43867%27 HTTP/1.1" 200 None
2026-03-28 10:45:12 [auto1.de] INFO: Scrape type for ZU43867: 0
2026-03-28 10:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:13 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 9656 | hits on page: 40
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: ZU43867
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43867%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for ZU43867: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: BL06566
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: KS49041
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for SD35692: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: LZ96644
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for KW39556: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV85283%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for NV85283: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: LR83692
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: KE96769
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE96769%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for KE96769: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: YX71503
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: YH65606
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH65606%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for YH65606: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: KL74101
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL74101%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for KL74101: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: PC37120
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: TJ80177
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ80177%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for TJ80177: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: UK07375
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: RC17718
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: SL45224
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45224%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for SL45224: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: YD41840
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: LJ92359
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: AF95896
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: DN70998
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH18492%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for KH18492: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: DR41029
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: BF45527
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF45527%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for BF45527: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: PY43658
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: RY13097
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY13097%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for RY13097: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH05972%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for FH05972: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: HD36742
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: CA82513
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA82513%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for CA82513: 0
2026-03-28 10:45:13 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-28 10:45:13 [auto1.de] INFO: Scrape type for TC39197: 2
2026-03-28 10:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 834d2273-1693-51b5-9a09-b261122eba2f with identifier: TC39197
2026-03-28 10:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 834d2273-1693-51b5-9a09-b261122eba2f with scrape type 2
2026-03-28 10:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 834d2273-1693-51b5-9a09-b261122eba2f with scrape type 2
2026-03-28 10:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 834d2273-1693-51b5-9a09-b261122eba2f, identifier: TC39197
2026-03-28 10:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 834d2273-1693-51b5-9a09-b261122eba2f with identifier: TC39197
2026-03-28 10:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 834d2273-1693-51b5-9a09-b261122eba2f with identifier: TC39197
2026-03-28 10:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 834d2273-1693-51b5-9a09-b261122eba2f with identifier: TC39197 to the API
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:37:05Z',
 'fuel_type': 'petrol',
 'id': '834d2273-1693-51b5-9a09-b261122eba2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC39197',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Grand Vitara',
 'odometer': 166895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-13',
 'seller_name': None,
 'title': 'Suzuki Grand Vitara 2.4 VVT Comfort',
 'transmission': 'automatic',
 'trim': 'VVT Comfort',
 'year': 2008}
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-28 10:45:14 [auto1.de] INFO: Saving data for TC39197: {'auction_closing_time': 1774715825.0, 'created_time': 1774510532.408597, 'last_price_update_time': 1774694714.661197}
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC39197') HTTP/1.1" 204 0
2026-03-28 10:45:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:14 [auto1.de] INFO: Found listing with ID: TP88372
2026-03-28 10:45:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:15 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: TP88372
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for NV31897: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: NN09397
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN09397%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for NN09397: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: ME32399
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME32399%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for ME32399: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for ZT22955: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF52928%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for MF52928: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for DZ38540: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: SH94739
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: WM81264
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM81264%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for WM81264: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85495%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for VR85495: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: PZ04284
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-28 10:45:15 [auto1.de] INFO: Scrape type for CF43434: 0
2026-03-28 10:45:15 [auto1.de] INFO: Found listing with ID: FT79731
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT79731%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for FT79731: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for LW30512: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: ZS26500
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: LC02400
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC02400%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for LC02400: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: BG27502
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ00075%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for YJ00075: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: KM40443
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40199%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for RK40199: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: MR13527
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: WU62760
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU62760%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for WU62760: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: DB98628
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: TE12513
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE12513%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for TE12513: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: GM94647
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM94647%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for GM94647: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: BS49761
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: GK30038
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK30038%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for GK30038: 0
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: MK32086
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-28 10:45:16 [auto1.de] INFO: Found listing with ID: ZP84126
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP84126%27 HTTP/1.1" 200 None
2026-03-28 10:45:16 [auto1.de] INFO: Scrape type for ZP84126: 0
2026-03-28 10:45:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:17 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: MZ53691
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ53691%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for MZ53691: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for JC14398: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: EJ11673
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ11673%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for EJ11673: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: GP79065
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP79065%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for GP79065: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: WV76032
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV76032%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for WV76032: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: KG77617
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG77617%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for KG77617: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: SD72171
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: ZU63901
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU63901%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for ZU63901: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: SU27774
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: LX73205
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for HC04240: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: MV64998
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV64998%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for MV64998: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45132%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for BH45132: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: FA77948
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA77948%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for FA77948: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC48090%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for BC48090: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for WP14042: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF22355%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for GF22355: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for XA54655: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: WK49047
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: BA71155
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS97689%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for BS97689: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: EV18023
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for YB86536: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: XC96921
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC96921%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for XC96921: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for BZ86499: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: GJ82091
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: DZ18684
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: CS22386
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: MJ41570
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41570%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for MJ41570: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: NZ41454
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL43028%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for VL43028: 0
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: AT21596
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: ME93940
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: PK76037
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: ZD11825
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-28 10:45:17 [auto1.de] INFO: Found listing with ID: CK82561
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK82561%27 HTTP/1.1" 200 None
2026-03-28 10:45:17 [auto1.de] INFO: Scrape type for CK82561: 0
2026-03-28 10:45:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:18 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: MJ46117
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: HH84290
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84290%27 HTTP/1.1" 200 None
2026-03-28 10:45:18 [auto1.de] INFO: Scrape type for HH84290: 0
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: RP33469
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP33469%27 HTTP/1.1" 200 None
2026-03-28 10:45:18 [auto1.de] INFO: Scrape type for RP33469: 0
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: VT95404
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-28 10:45:18 [auto1.de] INFO: Scrape type for ND67175: 0
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: CN84106
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: XV81276
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV81276%27 HTTP/1.1" 200 None
2026-03-28 10:45:18 [auto1.de] INFO: Scrape type for XV81276: 0
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: AB82349
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB82349%27 HTTP/1.1" 200 None
2026-03-28 10:45:18 [auto1.de] INFO: Scrape type for AB82349: 0
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: XR02791
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98396%27 HTTP/1.1" 200 None
2026-03-28 10:45:18 [auto1.de] INFO: Scrape type for FK98396: 0
2026-03-28 10:45:18 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH38301%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for KH38301: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: GW25301
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW25301%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for GW25301: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: DS74430
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS74430%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for DS74430: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: XE55302
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: GE49775
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE49775%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for GE49775: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: KN20653
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN20653%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for KN20653: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: ZZ49819
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: JF61688
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: ZM65799
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65799%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for ZM65799: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: LN55732
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: MM30364
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: SX57791
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX57791%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for SX57791: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: NM13557
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for DV41165: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for TP63692: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: LD46189
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD46189%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for LD46189: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: GU26871
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: XE39544
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE39544%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for XE39544: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for CF62011: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: UE09477
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE09477%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for UE09477: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: CC98432
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: PH91659
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH91659%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for PH91659: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for DR32988: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for DV40482: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: AR52184
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR52184%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for AR52184: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: JK90168
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK90168%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for JK90168: 0
2026-03-28 10:45:19 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY85656%27 HTTP/1.1" 200 None
2026-03-28 10:45:19 [auto1.de] INFO: Scrape type for WY85656: 0
2026-03-28 10:45:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:20 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for BR02529: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: RK01073
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: YM52195
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: VV84209
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV84209%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for VV84209: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: EW23969
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW23969%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for EW23969: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: FT93387
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: FH56090
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: PS41324
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS41324%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for PS41324: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: JB65350
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: MJ38460
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ38460%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for MJ38460: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: JC93229
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC93229%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for JC93229: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: LU46905
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46905%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for LU46905: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: RL83266
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83266%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for RL83266: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR42945%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for TR42945: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: UN09274
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN09274%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for UN09274: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: KH43150
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH43150%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for KH43150: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: PY53054
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: YU64534
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: BZ51273
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ51273%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for BZ51273: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: MV36698
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV36698%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for MV36698: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: GR83523
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83523%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for GR83523: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: BE42770
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: KJ27126
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: XA01561
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: JD86845
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD86845%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for JD86845: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: FX79800
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX79800%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for FX79800: 0
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-28 10:45:20 [auto1.de] INFO: Found listing with ID: AG57248
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG57248%27 HTTP/1.1" 200 None
2026-03-28 10:45:20 [auto1.de] INFO: Scrape type for AG57248: 0
2026-03-28 10:45:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:21 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM09243%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for RM09243: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: NX12512
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for PV27021: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD01270%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for WD01270: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for CS93004: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96479%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for XZ96479: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: YY13791
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for JY21775: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76387%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for UM76387: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: XS81054
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for DX42832: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: RV98185
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: XS50208
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50208%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for XS50208: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD51854%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for MD51854: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: RZ65813
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ65813%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for RZ65813: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: BZ50840
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ50840%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for BZ50840: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: TC55492
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: AR80743
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR80743%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for AR80743: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: LZ29816
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: JW22409
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: FE77986
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: GB55517
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for XY25128: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: UD97315
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: EW93148
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW93148%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for EW93148: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: ZN11233
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN11233%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for ZN11233: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: ME08351
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME08351%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for ME08351: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08351%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for DK08351: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: YG22612
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG22612%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for YG22612: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-28 10:45:21 [auto1.de] INFO: Scrape type for AY25775: 0
2026-03-28 10:45:21 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-28 10:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ22488%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for UZ22488: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: CT54176
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT54176%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for CT54176: 0
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ92306%27 HTTP/1.1" 200 None
2026-03-28 10:45:22 [auto1.de] INFO: Scrape type for YZ92306: 0
2026-03-28 10:45:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:22 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:22 [auto1.de] INFO: Found listing with ID: NA68427
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA68427%27 HTTP/1.1" 200 None
2026-03-28 10:45:23 [auto1.de] INFO: Scrape type for NA68427: 0
2026-03-28 10:45:23 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-28 10:45:23 [auto1.de] INFO: Scrape type for LS63557: 0
2026-03-28 10:45:23 [auto1.de] INFO: Found listing with ID: YB09580
2026-03-28 10:45:23 [auto1.de] INFO: Found listing with ID: GZ67786
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ67786%27 HTTP/1.1" 200 None
2026-03-28 10:45:23 [auto1.de] INFO: Scrape type for GZ67786: 0
2026-03-28 10:45:23 [auto1.de] INFO: Found listing with ID: UN40728
2026-03-28 10:45:23 [auto1.de] INFO: Found listing with ID: KU77644
2026-03-28 10:45:23 [auto1.de] INFO: Found listing with ID: RK25728
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK25728%27 HTTP/1.1" 200 None
2026-03-28 10:45:23 [auto1.de] INFO: Scrape type for RK25728: 2
2026-03-28 10:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7919a64e-3eca-5d73-ab9f-eab974957038 with identifier: RK25728
2026-03-28 10:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7919a64e-3eca-5d73-ab9f-eab974957038 with scrape type 2
2026-03-28 10:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7919a64e-3eca-5d73-ab9f-eab974957038 with scrape type 2
2026-03-28 10:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7919a64e-3eca-5d73-ab9f-eab974957038, identifier: RK25728
2026-03-28 10:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7919a64e-3eca-5d73-ab9f-eab974957038 with identifier: RK25728
2026-03-28 10:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7919a64e-3eca-5d73-ab9f-eab974957038 with identifier: RK25728
2026-03-28 10:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7919a64e-3eca-5d73-ab9f-eab974957038 with identifier: RK25728 to the API
2026-03-28 10:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:34:42Z',
 'fuel_type': 'diesel',
 'id': '7919a64e-3eca-5d73-ab9f-eab974957038',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK25728',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 256918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-03',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK25728%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Saving data for RK25728: {'auction_closing_time': 1774715682.0, 'created_time': 1773225876.872647, 'last_price_update_time': 1774694725.146524}
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK25728') HTTP/1.1" 204 0
2026-03-28 10:45:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: GE71174
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71174%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for GE71174: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: WL63965
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR16927%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for YR16927: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: PD02193
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: TY96424
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: ES32816
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: GE82925
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: BK55447
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: TD64872
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD64872%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for TD64872: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: VH83950
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH83950%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for VH83950: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: CS89362
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS89362%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for CS89362: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: BK72669
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK72669%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for BK72669: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: RL57383
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: SN89547
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN89547%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for SN89547: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: JX39487
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX39487%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for JX39487: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: NC93129
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV59345%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for ZV59345: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for PP25437: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: JC97573
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC97573%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for JC97573: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV60068%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for UV60068: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: KK41609
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: UV13467
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV13467%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for UV13467: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: RX19676
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX19676%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for RX19676: 0
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: HM31508
2026-03-28 10:45:25 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE88532%27 HTTP/1.1" 200 None
2026-03-28 10:45:25 [auto1.de] INFO: Scrape type for LE88532: 0
2026-03-28 10:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:27 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: CN59781
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: ZG99162
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG99162%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for ZG99162: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: YT47833
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47833%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for YT47833: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: VV51818
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV51818%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for VV51818: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: CT61733
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: WW54945
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW54945%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for WW54945: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: NC87687
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC87687%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for NC87687: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for FF39586: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: EL27695
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL27695%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for EL27695: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND00067%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for ND00067: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: ZF09358
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF09358%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for ZF09358: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: AE37337
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: AL53534
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL53534%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for AL53534: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: MK52280
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK52280%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for MK52280: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: TH96479
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH96479%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for TH96479: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: TD39885
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: KT42918
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: HY87386
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY87386%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for HY87386: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: HZ17968
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ17968%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for HZ17968: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: AF90097
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF90097%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for AF90097: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for JM70147: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: AN69467
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN69467%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for AN69467: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: VX66277
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX66277%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for VX66277: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: BB75752
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB75752%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for BB75752: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: RB10929
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB10929%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for RB10929: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for EL15513: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-28 10:45:27 [auto1.de] INFO: Scrape type for BE37865: 0
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-28 10:45:27 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-28 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-28 10:45:28 [auto1.de] INFO: Scrape type for AA02117: 0
2026-03-28 10:45:28 [auto1.de] INFO: Found listing with ID: SU97431
2026-03-28 10:45:28 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-28 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ86823%27 HTTP/1.1" 200 None
2026-03-28 10:45:28 [auto1.de] INFO: Scrape type for SJ86823: 0
2026-03-28 10:45:28 [auto1.de] INFO: Found listing with ID: NS70849
2026-03-28 10:45:28 [auto1.de] INFO: Found listing with ID: ZF90785
2026-03-28 10:45:28 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-28 10:45:28 [auto1.de] INFO: Found listing with ID: XZ80184
2026-03-28 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ80184%27 HTTP/1.1" 200 None
2026-03-28 10:45:28 [auto1.de] INFO: Scrape type for XZ80184: 0
2026-03-28 10:45:28 [auto1.de] INFO: Found listing with ID: GP51980
2026-03-28 10:45:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:30 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: XA96250
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA96250%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for XA96250: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: AP31336
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP31336%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for AP31336: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: DV16479
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: JH14314
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH14314%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for JH14314: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: VV42849
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: KD57874
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: PB20656
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for FJ59032: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for JB80015: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: WD61316
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD61316%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for WD61316: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: NK36025
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH58707%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for WH58707: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: XK74156
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: VG76144
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: HW97387
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW97387%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for HW97387: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: EB82059
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: EB35688
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB35688%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for EB35688: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for GZ76571: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: VU26984
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: TM51786
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: JZ28158
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ28158%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for JZ28158: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: LE56250
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE56250%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for LE56250: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG73343%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for WG73343: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: TL04129
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL04129%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for TL04129: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: TT42996
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY66672%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for XY66672: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for DM07006: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX59150%27 HTTP/1.1" 200 None
2026-03-28 10:45:30 [auto1.de] INFO: Scrape type for MX59150: 0
2026-03-28 10:45:30 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-28 10:45:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:33 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: TM28399
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM28399%27 HTTP/1.1" 200 None
2026-03-28 10:45:33 [auto1.de] INFO: Scrape type for TM28399: 0
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: NG35588
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX26542%27 HTTP/1.1" 200 None
2026-03-28 10:45:33 [auto1.de] INFO: Scrape type for DX26542: 0
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-28 10:45:33 [auto1.de] INFO: Scrape type for HM43288: 0
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: GW92568
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW92568%27 HTTP/1.1" 200 None
2026-03-28 10:45:33 [auto1.de] INFO: Scrape type for GW92568: 0
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-28 10:45:33 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-28 10:45:33 [auto1.de] INFO: Scrape type for XP03484: 2
2026-03-28 10:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e256e908-a9d6-5147-b47d-1c18d2428160 with identifier: XP03484
2026-03-28 10:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e256e908-a9d6-5147-b47d-1c18d2428160 with scrape type 2
2026-03-28 10:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e256e908-a9d6-5147-b47d-1c18d2428160 with scrape type 2
2026-03-28 10:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e256e908-a9d6-5147-b47d-1c18d2428160, identifier: XP03484
2026-03-28 10:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e256e908-a9d6-5147-b47d-1c18d2428160 with identifier: XP03484
2026-03-28 10:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e256e908-a9d6-5147-b47d-1c18d2428160 with identifier: XP03484
2026-03-28 10:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e256e908-a9d6-5147-b47d-1c18d2428160 with identifier: XP03484 to the API
2026-03-28 10:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:03:04Z',
 'fuel_type': 'diesel',
 'id': 'e256e908-a9d6-5147-b47d-1c18d2428160',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP03484',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 187061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-05',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-28 10:45:34 [auto1.de] INFO: Saving data for XP03484: {'auction_closing_time': 1774713784.0, 'created_time': 1773946075.825579, 'last_price_update_time': 1774694734.925524}
2026-03-28 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP03484') HTTP/1.1" 204 0
2026-03-28 10:45:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:35 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-28 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91773%27 HTTP/1.1" 200 None
2026-03-28 10:45:35 [auto1.de] INFO: Scrape type for WM91773: 2
2026-03-28 10:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773
2026-03-28 10:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f7075b-5dd6-542e-9425-2824bdcd3a69 with scrape type 2
2026-03-28 10:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f7075b-5dd6-542e-9425-2824bdcd3a69 with scrape type 2
2026-03-28 10:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8f7075b-5dd6-542e-9425-2824bdcd3a69, identifier: WM91773
2026-03-28 10:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773
2026-03-28 10:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773
2026-03-28 10:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773 to the API
2026-03-28 10:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:34:50Z',
 'fuel_type': 'petrol',
 'id': 'd8f7075b-5dd6-542e-9425-2824bdcd3a69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM91773',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 123101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-30',
 'seller_name': None,
 'title': 'Ford Focus 1.8 Flexifuel Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91773%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Saving data for WM91773: {'auction_closing_time': 1774715690.0, 'created_time': 1773132170.149881, 'last_price_update_time': 1774694736.547799}
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM91773') HTTP/1.1" 204 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: SF00674
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00674%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for SF00674: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: RP81387
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for GJ26621: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: KW54654
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: CA74097
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: US56828
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: PL21406
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: NK11674
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK11674%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for NK11674: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM53141%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for CM53141: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: YF83058
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: TS13333
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: KL09374
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL09374%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for KL09374: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: LC07612
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: BC57293
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for YH55403: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB12349%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for WB12349: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: YS42401
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: PF56750
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: SS34696
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: ED19877
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: TP76478
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP76478%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for TP76478: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for XB58662: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK09580%27 HTTP/1.1" 200 None
2026-03-28 10:45:36 [auto1.de] INFO: Scrape type for HK09580: 0
2026-03-28 10:45:36 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-28 10:45:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:39 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 9657 | hits on page: 40
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN95943%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for HN95943: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: FK01435
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: SM97641
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for HR12459: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for VK72696: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: RM36299
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA72326%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for JA72326: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: MJ50234
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ50234%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for MJ50234: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: WP19217
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP19217%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for WP19217: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: GM22494
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: WA51646
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51646%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for WA51646: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: FX28267
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for BG36952: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: ZL47575
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL47575%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for ZL47575: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: VG80520
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: EY08690
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY08690%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for EY08690: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: VE85769
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85769%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for VE85769: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: LZ61913
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: XT31458
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT31458%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for XT31458: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for DS04882: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: CW96220
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: ZU82710
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82710%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for ZU82710: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: EA35608
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: AL17067
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL17067%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for AL17067: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: WE17641
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE17641%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for WE17641: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for LZ26330: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: BP83751
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: NT96701
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT96701%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for NT96701: 0
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-28 10:45:39 [auto1.de] INFO: Found listing with ID: AY92583
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY92583%27 HTTP/1.1" 200 None
2026-03-28 10:45:39 [auto1.de] INFO: Scrape type for AY92583: 0
2026-03-28 10:45:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:45:51 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 9658 | hits on page: 40
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: AY92583
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY92583%27 HTTP/1.1" 200 None
2026-03-28 10:45:51 [auto1.de] INFO: Scrape type for AY92583: 0
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: MP72809
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: KU29056
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU29056%27 HTTP/1.1" 200 None
2026-03-28 10:45:51 [auto1.de] INFO: Scrape type for KU29056: 0
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: PB67262
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: DP65043
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: NN10939
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN10939%27 HTTP/1.1" 200 None
2026-03-28 10:45:51 [auto1.de] INFO: Scrape type for NN10939: 0
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-28 10:45:51 [auto1.de] INFO: Scrape type for GU60494: 0
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: VF90818
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF90818%27 HTTP/1.1" 200 None
2026-03-28 10:45:51 [auto1.de] INFO: Scrape type for VF90818: 0
2026-03-28 10:45:51 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for NY21217: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR56375%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for SR56375: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71424%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for RE71424: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: XW98427
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW98427%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for XW98427: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: ML73813
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR49989%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for LR49989: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV87591%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for YV87591: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: HD49679
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD49679%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for HD49679: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: DC75837
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: GB09367
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT42363%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for DT42363: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: DK27317
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK27317%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for DK27317: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: WL60087
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: CR45674
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for MP23640: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK32817%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for RK32817: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: FR24268
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR24268%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for FR24268: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02409%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for FB02409: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: UT71403
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT71403%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for UT71403: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: LL49213
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL49213%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for LL49213: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: RM06492
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM06492%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for RM06492: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for FL79995: 0
2026-03-28 10:45:52 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-28 10:45:52 [auto1.de] INFO: Scrape type for NU80618: 2
2026-03-28 10:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 694a5e0e-e8ac-5370-877c-42471d4b3060 with identifier: NU80618
2026-03-28 10:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 694a5e0e-e8ac-5370-877c-42471d4b3060 with scrape type 2
2026-03-28 10:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 694a5e0e-e8ac-5370-877c-42471d4b3060 with scrape type 2
2026-03-28 10:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 694a5e0e-e8ac-5370-877c-42471d4b3060, identifier: NU80618
2026-03-28 10:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 694a5e0e-e8ac-5370-877c-42471d4b3060 with identifier: NU80618
2026-03-28 10:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 694a5e0e-e8ac-5370-877c-42471d4b3060 with identifier: NU80618
2026-03-28 10:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 694a5e0e-e8ac-5370-877c-42471d4b3060 with identifier: NU80618 to the API
2026-03-28 10:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:18:28Z',
 'fuel_type': 'petrol',
 'id': '694a5e0e-e8ac-5370-877c-42471d4b3060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU80618',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 201154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-17',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.8 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2009}
2026-03-28 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-28 10:45:53 [auto1.de] INFO: Saving data for NU80618: {'auction_closing_time': 1774714708.0, 'created_time': 1774510535.567979, 'last_price_update_time': 1774694753.652809}
2026-03-28 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU80618') HTTP/1.1" 204 0
2026-03-28 10:45:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:45:53 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-28 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-28 10:45:53 [auto1.de] INFO: Scrape type for RU42318: 0
2026-03-28 10:45:53 [auto1.de] INFO: Found listing with ID: MG91199
2026-03-28 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG91199%27 HTTP/1.1" 200 None
2026-03-28 10:45:53 [auto1.de] INFO: Scrape type for MG91199: 0
2026-03-28 10:45:53 [auto1.de] INFO: Found listing with ID: XB91426
2026-03-28 10:46:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:46:02 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 9659 | hits on page: 40
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: XB91426
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: MC26208
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC26208%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for MC26208: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: GJ57760
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ57760%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for GJ57760: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73613%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for MR73613: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: GR60102
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: XR86863
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR86863%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for XR86863: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: UW93574
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for BE24372: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: MX91312
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: JY81419
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: EZ23867
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: FA60427
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA60427%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for FA60427: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: KD74504
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: RK40243
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for FH98757: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: EC42355
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: YS11001
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS11001%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for YS11001: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: SC67475
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC67475%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for SC67475: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: JK59865
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: JJ18730
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ18730%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for JJ18730: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for NB45839: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for WP48993: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: VT29365
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: LR25618
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR25618%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for LR25618: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: VZ74394
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ74394%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for VZ74394: 0
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-28 10:46:02 [auto1.de] INFO: Found listing with ID: NE03799
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE03799%27 HTTP/1.1" 200 None
2026-03-28 10:46:02 [auto1.de] INFO: Scrape type for NE03799: 0
2026-03-28 10:46:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:46:06 [scrapy.extensions.logstats] INFO: Crawled 291 pages (at 16 pages/min), scraped 208 items (at 6 items/min)
2026-03-28 10:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:46:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:46:06 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 9659 | hits on page: 40
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: VX61126
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX61126%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for VX61126: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: LA58021
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA58021%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for LA58021: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: MP73357
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: AH41759
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: FW28639
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW28639%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for FW28639: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: KD39094
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: PL18680
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL18680%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for PL18680: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: GB96559
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: WG34535
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for FS91363: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: VJ37696
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ37696%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for VJ37696: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: KB53133
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for JJ90967: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for MR37276: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: ZX35425
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35425%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for ZX35425: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: PJ24227
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: PX70527
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX70527%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for PX70527: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: JL65516
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: DH25431
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: XC99684
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC99684%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for XC99684: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: SN64642
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for VH61695: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: NT23375
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23375%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for NT23375: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: AV48521
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV48521%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for AV48521: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41953%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for ZH41953: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: CP53308
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: RP45583
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP45583%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for RP45583: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: VC17090
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC17090%27 HTTP/1.1" 200 None
2026-03-28 10:46:06 [auto1.de] INFO: Scrape type for VC17090: 0
2026-03-28 10:46:06 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-28 10:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE71372%27 HTTP/1.1" 200 None
2026-03-28 10:46:07 [auto1.de] INFO: Scrape type for FE71372: 0
2026-03-28 10:46:07 [auto1.de] INFO: Found listing with ID: KV09163
2026-03-28 10:46:07 [auto1.de] INFO: Found listing with ID: VG95526
2026-03-28 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG95526%27 HTTP/1.1" 200 None
2026-03-28 10:46:07 [auto1.de] INFO: Scrape type for VG95526: 0
2026-03-28 10:46:07 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-28 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-28 10:46:07 [auto1.de] INFO: Scrape type for MP89368: 0
2026-03-28 10:46:07 [auto1.de] INFO: Found listing with ID: EC98631
2026-03-28 10:46:07 [auto1.de] INFO: Found listing with ID: GG51597
2026-03-28 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG51597%27 HTTP/1.1" 200 None
2026-03-28 10:46:07 [auto1.de] INFO: Scrape type for GG51597: 0
2026-03-28 10:46:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:06 [scrapy.extensions.logstats] INFO: Crawled 292 pages (at 1 pages/min), scraped 208 items (at 0 items/min)
2026-03-28 10:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:47:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:12 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 9664 | hits on page: 40
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: KV09163
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: VG95526
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG95526%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for VG95526: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for MP89368: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: EC98631
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: GG51597
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG51597%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for GG51597: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: FN83221
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN83221%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for FN83221: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: FV69098
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: CL15351
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL15351%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for CL15351: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: FD13282
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD13282%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for FD13282: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for KX24751: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: HS47507
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: UY83334
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP43988%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for TP43988: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP72129%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for BP72129: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: VC02899
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: CP21456
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: RB81388
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: TJ40374
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ40374%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for TJ40374: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: BJ59034
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ59034%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for BJ59034: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: YC00540
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00540%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for YC00540: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-28 10:47:12 [auto1.de] INFO: Scrape type for XT50939: 0
2026-03-28 10:47:12 [auto1.de] INFO: Found listing with ID: DF24349
2026-03-28 10:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF24349%27 HTTP/1.1" 200 None
2026-03-28 10:47:13 [auto1.de] INFO: Scrape type for DF24349: 0
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: XC05261
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: RG64089
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG64089%27 HTTP/1.1" 200 None
2026-03-28 10:47:13 [auto1.de] INFO: Scrape type for RG64089: 0
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: AF02191
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF02191%27 HTTP/1.1" 200 None
2026-03-28 10:47:13 [auto1.de] INFO: Scrape type for AF02191: 0
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-28 10:47:13 [auto1.de] INFO: Scrape type for CN06101: 0
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23730%27 HTTP/1.1" 200 None
2026-03-28 10:47:13 [auto1.de] INFO: Scrape type for ZD23730: 0
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD10656%27 HTTP/1.1" 200 None
2026-03-28 10:47:13 [auto1.de] INFO: Scrape type for LD10656: 0
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: NY16629
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: JC12904
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-28 10:47:13 [auto1.de] INFO: Scrape type for SM09271: 0
2026-03-28 10:47:13 [auto1.de] INFO: Found listing with ID: RX38122
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX38122%27 HTTP/1.1" 200 None
2026-03-28 10:47:13 [auto1.de] INFO: Scrape type for RX38122: 0
2026-03-28 10:47:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:14 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 9664 | hits on page: 40
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: SX67317
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: MS04579
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS04579%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for MS04579: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: XM71416
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: KR30389
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: JX93926
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX93926%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for JX93926: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for MR02811: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for TE18178: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: JL42140
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL42140%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for JL42140: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: ZR85378
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: HY62611
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62611%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for HY62611: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: JM60205
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: XC77974
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: MF87973
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF87973%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for MF87973: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for BB37977: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63876%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for DZ63876: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: AE27507
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE27507%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for AE27507: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: KT42001
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: RX73377
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX73377%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for RX73377: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: RW07911
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW07911%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for RW07911: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: SM08182
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for FM78984: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: WU50689
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: AF68122
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for UB61823: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for CN74001: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: UW10679
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: SC80606
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: CC80699
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC80699%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for CC80699: 0
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: ZF80187
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-28 10:47:14 [auto1.de] INFO: Found listing with ID: PP91076
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP91076%27 HTTP/1.1" 200 None
2026-03-28 10:47:14 [auto1.de] INFO: Scrape type for PP91076: 0
2026-03-28 10:47:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:15 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 9664 | hits on page: 40
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: ZT12374
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for HM75653: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: CS71066
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS71066%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for CS71066: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: SW04854
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW04854%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for SW04854: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: RH18539
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH18539%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for RH18539: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: PD05251
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: DC87160
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC87160%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for DC87160: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for WZ38880: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: XK64077
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: WD55827
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55827%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for WD55827: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: EX30912
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX30912%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for EX30912: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: MP81414
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP81414%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for MP81414: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32839%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for TN32839: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: TE76354
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: SB33889
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB33889%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for SB33889: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: TC03935
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC03935%27 HTTP/1.1" 200 None
2026-03-28 10:47:15 [auto1.de] INFO: Scrape type for TC03935: 0
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: EM65900
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: MG42268
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: MP16607
2026-03-28 10:47:15 [auto1.de] INFO: Found listing with ID: JY89366
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY89366%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for JY89366: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00695%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for BU00695: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: NA04350
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for PD62787: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: WP40343
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP40343%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for WP40343: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: LH79634
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: FM58881
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM58881%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for FM58881: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: HA73784
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: DZ69774
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: YR73965
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for PH27110: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: JZ59846
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for ML64265: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH20850%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for GH20850: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70059%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for EA70059: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: JS64304
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64304%27 HTTP/1.1" 200 None
2026-03-28 10:47:16 [auto1.de] INFO: Scrape type for JS64304: 0
2026-03-28 10:47:16 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-28 10:47:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:17 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 9664 | hits on page: 40
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: ML82340
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for CL60178: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: HL40021
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: GT12052
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: ZL85266
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: XT10731
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: CW98774
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: CA15258
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: ZG64364
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: NM07920
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: BP47263
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP47263%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for BP47263: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: HS50383
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS50383%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for HS50383: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: BV07882
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for XZ81913: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: NB15408
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: HC41617
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: YE23414
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: ZT65198
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: GL26328
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL26328%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for GL26328: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: DU86117
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for AF99280: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ75916%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for HZ75916: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for HE65946: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: LL46180
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL46180%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for LL46180: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for NE31655: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: FF33829
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF33829%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for FF33829: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: LC24669
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: LY01980
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: TP41556
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for VL46030: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: TW00393
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW00393%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for TW00393: 0
2026-03-28 10:47:17 [auto1.de] INFO: Found listing with ID: BK38735
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK38735%27 HTTP/1.1" 200 None
2026-03-28 10:47:17 [auto1.de] INFO: Scrape type for BK38735: 0
2026-03-28 10:47:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:20 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 9664 | hits on page: 40
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for AV40802: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: TH33343
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for EZ76409: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: MY07793
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: JM29526
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM29526%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for JM29526: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: WS21373
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: UU82281
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB95771%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for FB95771: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: VZ69122
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ69122%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for VZ69122: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for UW12612: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: MU43821
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU43821%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for MU43821: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for RT09261: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: YF97500
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF97500%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for YF97500: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: RU37876
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: PG24106
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: JL53088
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL53088%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for JL53088: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for VT41344: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: RD87783
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD87783%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for RD87783: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: BV34042
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV34042%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for BV34042: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: AP11154
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP11154%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for AP11154: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: CZ93275
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ93275%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for CZ93275: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: MT27523
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT27523%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for MT27523: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: PX90608
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX90608%27 HTTP/1.1" 200 None
2026-03-28 10:47:20 [auto1.de] INFO: Scrape type for PX90608: 0
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: KG59936
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: SN35212
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: HU03787
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: VU91072
2026-03-28 10:47:20 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-28 10:47:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:22 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 9664 | hits on page: 40
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: MN64369
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: ED76181
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: RN08070
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN08070%27 HTTP/1.1" 200 None
2026-03-28 10:47:22 [auto1.de] INFO: Scrape type for RN08070: 0
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: RV28657
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV28657%27 HTTP/1.1" 200 None
2026-03-28 10:47:22 [auto1.de] INFO: Scrape type for RV28657: 0
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: RK34860
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK34860%27 HTTP/1.1" 200 None
2026-03-28 10:47:22 [auto1.de] INFO: Scrape type for RK34860: 0
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: GF47308
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF47308%27 HTTP/1.1" 200 None
2026-03-28 10:47:22 [auto1.de] INFO: Scrape type for GF47308: 0
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY63030%27 HTTP/1.1" 200 None
2026-03-28 10:47:22 [auto1.de] INFO: Scrape type for UY63030: 0
2026-03-28 10:47:22 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-28 10:47:22 [auto1.de] INFO: Scrape type for ME06173: 2
2026-03-28 10:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with identifier: ME06173
2026-03-28 10:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with scrape type 2
2026-03-28 10:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with scrape type 2
2026-03-28 10:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e, identifier: ME06173
2026-03-28 10:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with identifier: ME06173
2026-03-28 10:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with identifier: ME06173
2026-03-28 10:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e with identifier: ME06173 to the API
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:42:52Z',
 'fuel_type': 'diesel',
 'id': 'ce1e19ef-c8df-5af7-bbc0-a88c3e8ba19e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME06173',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 273530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-28',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Saving data for ME06173: {'auction_closing_time': 1774716172.0, 'created_time': 1774510545.04557, 'last_price_update_time': 1774694843.448093}
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME06173') HTTP/1.1" 204 0
2026-03-28 10:47:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP40069%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Scrape type for NP40069: 0
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: JB31232
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB31232%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Scrape type for JB31232: 0
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: LU32216
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: WX65526
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX65526%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Scrape type for WX65526: 0
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: TG18023
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN23082%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Scrape type for FN23082: 0
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: PP57494
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: NU57672
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: NX98463
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: BH79353
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH79353%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Scrape type for BH79353: 0
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: EV47698
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: LR04011
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: CK66212
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: LS52090
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: ZT39805
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: ZG00805
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: BN46018
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN46018%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Scrape type for BN46018: 0
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Scrape type for NZ21452: 0
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB21377%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Scrape type for EB21377: 0
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG14715%27 HTTP/1.1" 200 None
2026-03-28 10:47:23 [auto1.de] INFO: Scrape type for LG14715: 0
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: MW19833
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: XR23222
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: AW57612
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: VV06990
2026-03-28 10:47:23 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-28 10:47:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:26 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: PV23969
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: VP95925
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP95925%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for VP95925: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: EJ11431
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ11431%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for EJ11431: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: YF17855
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: HV72401
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV72401%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for HV72401: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: FX38179
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: KZ72468
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX37466%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for NX37466: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ91667%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for NZ91667: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: GN02679
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: MW52698
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: EX50371
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: SM53889
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: ZJ15384
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ15384%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for ZJ15384: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: EJ51089
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ51089%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for EJ51089: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: RH43725
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH43725%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for RH43725: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: HL37424
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: TK41211
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK41211%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for TK41211: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for ZY94421: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: WC75235
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: DA54133
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: EH94118
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94118%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for EH94118: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: PV02416
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV02416%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for PV02416: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: RG17194
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: UV04779
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: WD56073
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: MS74297
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS74297%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for MS74297: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for AR72060: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40281%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for AF40281: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: YM05661
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM05661%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for YM05661: 0
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: HK56220
2026-03-28 10:47:26 [auto1.de] INFO: Found listing with ID: XE60710
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE60710%27 HTTP/1.1" 200 None
2026-03-28 10:47:26 [auto1.de] INFO: Scrape type for XE60710: 0
2026-03-28 10:47:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:27 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:27 [auto1.de] INFO: Found listing with ID: NC17523
2026-03-28 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC17523%27 HTTP/1.1" 200 None
2026-03-28 10:47:27 [auto1.de] INFO: Scrape type for NC17523: 0
2026-03-28 10:47:27 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-28 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL95475%27 HTTP/1.1" 200 None
2026-03-28 10:47:27 [auto1.de] INFO: Scrape type for HL95475: 0
2026-03-28 10:47:27 [auto1.de] INFO: Found listing with ID: UY88235
2026-03-28 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY88235%27 HTTP/1.1" 200 None
2026-03-28 10:47:27 [auto1.de] INFO: Scrape type for UY88235: 0
2026-03-28 10:47:27 [auto1.de] INFO: Found listing with ID: XL96433
2026-03-28 10:47:27 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-28 10:47:27 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-28 10:47:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for NF12247: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: NC53350
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: AN47371
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN47371%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for AN47371: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: CP02009
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01319%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for DV01319: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: KL64193
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL64193%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for KL64193: 2
2026-03-28 10:47:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0ef5e49-7862-5a75-b85a-9d26df42a2d8 with identifier: KL64193
2026-03-28 10:47:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0ef5e49-7862-5a75-b85a-9d26df42a2d8 with scrape type 2
2026-03-28 10:47:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0ef5e49-7862-5a75-b85a-9d26df42a2d8 with scrape type 2
2026-03-28 10:47:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0ef5e49-7862-5a75-b85a-9d26df42a2d8, identifier: KL64193
2026-03-28 10:47:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0ef5e49-7862-5a75-b85a-9d26df42a2d8 with identifier: KL64193
2026-03-28 10:47:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0ef5e49-7862-5a75-b85a-9d26df42a2d8 with identifier: KL64193
2026-03-28 10:47:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0ef5e49-7862-5a75-b85a-9d26df42a2d8 with identifier: KL64193 to the API
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:47:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:49Z',
 'fuel_type': 'petrol',
 'id': 'd0ef5e49-7862-5a75-b85a-9d26df42a2d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL64193',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 207090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-23',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.4 TFSI ACT Ambition ultra',
 'transmission': 'automatic',
 'trim': 'Ambition ultra',
 'year': 2014}
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL64193%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Saving data for KL64193: {'auction_closing_time': 1774716229.0, 'created_time': 1773307252.666206, 'last_price_update_time': 1774694848.546875}
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL64193') HTTP/1.1" 204 0
2026-03-28 10:47:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for SY11611: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK19274%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for RK19274: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06159%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for SC06159: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: BH13413
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: FP74638
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP74638%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for FP74638: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: HY48738
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48738%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for HY48738: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: ZH02957
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK91051%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for HK91051: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: DS39411
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: VS91117
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for PB41592: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: CR26579
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26579%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for CR26579: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for LR33805: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: TD14056
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: RR62010
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: HS70377
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS70377%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for HS70377: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for RD35105: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: VP80711
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP80711%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for VP80711: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP08791%27 HTTP/1.1" 200 None
2026-03-28 10:47:28 [auto1.de] INFO: Scrape type for BP08791: 0
2026-03-28 10:47:28 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-28 10:47:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:30 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72223%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for VH72223: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: SB59394
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: DY48174
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: UY11294
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: AB69673
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB69673%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for AB69673: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: HM40523
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: YV51703
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV51703%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for YV51703: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: BT69542
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69542%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for BT69542: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for XS43563: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: YV26215
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: AX44497
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for PG58570: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: SS40295
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: DS42443
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS42443%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for DS42443: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: SD15170
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15170%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for SD15170: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD27320%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for MD27320: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15690%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for LR15690: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: GE10245
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE10245%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for GE10245: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: PW24553
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW24553%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for PW24553: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: JC94959
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: YT48506
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: TL31198
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL31198%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for TL31198: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for ST88871: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: SW30333
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW30333%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for SW30333: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: WP44552
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: LK69228
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: WL05450
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL05450%27 HTTP/1.1" 200 None
2026-03-28 10:47:30 [auto1.de] INFO: Scrape type for WL05450: 0
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-28 10:47:30 [auto1.de] INFO: Found listing with ID: KA31515
2026-03-28 10:47:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:31 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: JP52122
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK52975%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for BK52975: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: VU23200
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU23200%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for VU23200: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for KM26302: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: WB94414
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: GB35925
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: BY57485
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY57485%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for BY57485: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: GR15178
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: HX50499
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX50499%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for HX50499: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: GV04450
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV04450%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for GV04450: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: NC07497
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07497%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for NC07497: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for CC99000: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: PM61322
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM61322%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for PM61322: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: FD42571
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for GJ53227: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: HS15462
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: GP04405
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: FU27618
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU27618%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for FU27618: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: MS18045
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18045%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for MS18045: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: NJ21212
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ21212%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for NJ21212: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: WA59870
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA59870%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for WA59870: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: PP05974
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: YL90349
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL90349%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for YL90349: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: SG28912
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28912%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for SG28912: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: WL74765
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL74765%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for WL74765: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: RC95645
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95645%27 HTTP/1.1" 200 None
2026-03-28 10:47:31 [auto1.de] INFO: Scrape type for RC95645: 0
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-28 10:47:31 [auto1.de] INFO: Found listing with ID: RE35722
2026-03-28 10:47:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:32 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: YL65079
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for TG47191: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: WA93069
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: CV90861
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18756%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for MS18756: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: VG72700
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: XJ79433
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ79433%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for XJ79433: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: KR27506
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for BB52240: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: NK01451
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK01451%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for NK01451: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: JR94106
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for HU72855: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for HT34266: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: ZS42490
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS42490%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for ZS42490: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: SC11687
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC11687%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for SC11687: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: XY56978
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY56978%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for XY56978: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: GK61319
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK61319%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for GK61319: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: DV16657
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: JM68743
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM68743%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for JM68743: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: KT67254
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX34445%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for KX34445: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: YD08284
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD08284%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for YD08284: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: TR81218
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81218%27 HTTP/1.1" 200 None
2026-03-28 10:47:32 [auto1.de] INFO: Scrape type for TR81218: 0
2026-03-28 10:47:32 [auto1.de] INFO: Found listing with ID: RS40797
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40797%27 HTTP/1.1" 200 None
2026-03-28 10:47:33 [auto1.de] INFO: Scrape type for RS40797: 0
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-28 10:47:33 [auto1.de] INFO: Scrape type for MU50288: 0
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ77178%27 HTTP/1.1" 200 None
2026-03-28 10:47:33 [auto1.de] INFO: Scrape type for HJ77178: 0
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-28 10:47:33 [auto1.de] INFO: Scrape type for BH21613: 0
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: CN04574
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: GT95785
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: ME08770
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ46683%27 HTTP/1.1" 200 None
2026-03-28 10:47:33 [auto1.de] INFO: Scrape type for JZ46683: 0
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: WT07379
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT07379%27 HTTP/1.1" 200 None
2026-03-28 10:47:33 [auto1.de] INFO: Scrape type for WT07379: 0
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: BU09322
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: HZ43600
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ43600%27 HTTP/1.1" 200 None
2026-03-28 10:47:33 [auto1.de] INFO: Scrape type for HZ43600: 0
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-28 10:47:33 [auto1.de] INFO: Scrape type for PX80115: 0
2026-03-28 10:47:33 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-28 10:47:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:34 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-28 10:47:34 [auto1.de] INFO: Scrape type for ZE36621: 0
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: TY52919
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-28 10:47:34 [auto1.de] INFO: Scrape type for UR98494: 0
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: RU06451
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: YY05460
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY05460%27 HTTP/1.1" 200 None
2026-03-28 10:47:34 [auto1.de] INFO: Scrape type for YY05460: 0
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: FB23073
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45042%27 HTTP/1.1" 200 None
2026-03-28 10:47:34 [auto1.de] INFO: Scrape type for WL45042: 0
2026-03-28 10:47:34 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-28 10:47:34 [auto1.de] INFO: Scrape type for AA98436: 2
2026-03-28 10:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6cdecf1-c74d-56ff-8947-d46ccb87b34d with identifier: AA98436
2026-03-28 10:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6cdecf1-c74d-56ff-8947-d46ccb87b34d with scrape type 2
2026-03-28 10:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6cdecf1-c74d-56ff-8947-d46ccb87b34d with scrape type 2
2026-03-28 10:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6cdecf1-c74d-56ff-8947-d46ccb87b34d, identifier: AA98436
2026-03-28 10:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6cdecf1-c74d-56ff-8947-d46ccb87b34d with identifier: AA98436
2026-03-28 10:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6cdecf1-c74d-56ff-8947-d46ccb87b34d with identifier: AA98436
2026-03-28 10:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6cdecf1-c74d-56ff-8947-d46ccb87b34d with identifier: AA98436 to the API
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:26:10Z',
 'fuel_type': 'petrol',
 'id': 'c6cdecf1-c74d-56ff-8947-d46ccb87b34d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA98436',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 52995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-31',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Saving data for AA98436: {'auction_closing_time': 1774715170.0, 'created_time': 1773344640.681668, 'last_price_update_time': 1774694855.094052}
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA98436') HTTP/1.1" 204 0
2026-03-28 10:47:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: CZ24918
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ24918%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for CZ24918: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: YR22562
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR22562%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for YR22562: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: GR85769
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: YF58476
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF58476%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for YF58476: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: FT39707
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL87499%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for EL87499: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: ZG88444
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG88444%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for ZG88444: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: EL37075
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL37075%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for EL37075: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for AX08023: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: GL08454
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for VU06993: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: CJ78227
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: XW80989
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW80989%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for XW80989: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47615%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for EJ47615: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: DR71954
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: SN40522
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40522%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for SN40522: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: SY14600
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: PH98737
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: SF52194
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF52194%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for SF52194: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: VW86065
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: VZ54866
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: LA56471
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA56471%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for LA56471: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for MK79183: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: TJ08431
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for BR43966: 0
2026-03-28 10:47:35 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-28 10:47:35 [auto1.de] INFO: Scrape type for TL68554: 0
2026-03-28 10:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:36 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: NZ84353
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: ST39161
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST39161%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for ST39161: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: XY22197
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: LZ81605
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: CJ47476
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ47476%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for CJ47476: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for MB08927: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: AG51690
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG51690%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for AG51690: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for KS41473: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: YM31567
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: CV85765
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: AG29521
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: AC43250
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC43250%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for AC43250: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for YW50653: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: PB72951
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM94615%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for WM94615: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: LG52677
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: DB49845
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB49845%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for DB49845: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: FN07032
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN07032%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for FN07032: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: NZ83271
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: UF26861
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF26861%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for UF26861: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: ET42367
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: WG43761
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: SG57857
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG57857%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for SG57857: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: XN13180
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN13180%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for XN13180: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: JW06785
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: LE51560
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE51560%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for LE51560: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: RA83567
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: BV43774
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV43774%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for BV43774: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: XP05146
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP05146%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for XP05146: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: JH33807
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH33807%27 HTTP/1.1" 200 None
2026-03-28 10:47:36 [auto1.de] INFO: Scrape type for JH33807: 0
2026-03-28 10:47:36 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-28 10:47:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:37 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: UM56474
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM56474%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for UM56474: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: DU13995
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: NV07015
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX35600%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for WX35600: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: LU68586
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: AA62808
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA62808%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for AA62808: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: UR01748
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for LN76006: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: KA74482
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: ZJ08757
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for LX71576: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for AC69838: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: PR12884
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR12884%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for PR12884: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: NT99648
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT99648%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for NT99648: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: YS92779
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS92779%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for YS92779: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95314%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for JY95314: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH94103%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for XH94103: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: TS84249
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS84249%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for TS84249: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: JJ89633
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ89633%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for JJ89633: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50819%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for TH50819: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: WK04531
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: NX49590
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: CK76126
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM08795%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for GM08795: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: PM90514
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM90514%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for PM90514: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: EA46191
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: YD12708
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: SF95135
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF95135%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for SF95135: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: GW25108
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-28 10:47:37 [auto1.de] INFO: Scrape type for CA65942: 0
2026-03-28 10:47:37 [auto1.de] INFO: Found listing with ID: YK99793
2026-03-28 10:47:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:40 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: BF84298
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: KT12333
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: SE74775
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: RL13206
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL13206%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for RL13206: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: VR66092
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH31418%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for KH31418: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA57205%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for LA57205: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: UC83372
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for HY14352: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: MR23969
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23969%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for MR23969: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: JV02966
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV02966%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for JV02966: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: LN11625
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: CJ75099
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: GV90609
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for LF76340: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: NA81558
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: RP40821
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: PB76196
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB76196%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for PB76196: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for WP86079: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for NE13487: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: YB31045
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB31045%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for YB31045: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: WJ62953
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ62953%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for WJ62953: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: GN74176
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: KT54325
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: RR48020
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR48020%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for RR48020: 0
2026-03-28 10:47:40 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-28 10:47:40 [auto1.de] INFO: Scrape type for ZY58366: 2
2026-03-28 10:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c9b454-c414-501f-b4ba-a2633e7b053f with identifier: ZY58366
2026-03-28 10:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c9b454-c414-501f-b4ba-a2633e7b053f with scrape type 2
2026-03-28 10:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89c9b454-c414-501f-b4ba-a2633e7b053f with scrape type 2
2026-03-28 10:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89c9b454-c414-501f-b4ba-a2633e7b053f, identifier: ZY58366
2026-03-28 10:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89c9b454-c414-501f-b4ba-a2633e7b053f with identifier: ZY58366
2026-03-28 10:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89c9b454-c414-501f-b4ba-a2633e7b053f with identifier: ZY58366
2026-03-28 10:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89c9b454-c414-501f-b4ba-a2633e7b053f with identifier: ZY58366 to the API
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:42:43Z',
 'fuel_type': 'petrol',
 'id': '89c9b454-c414-501f-b4ba-a2633e7b053f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY58366',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 82525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-28 10:47:41 [auto1.de] INFO: Saving data for ZY58366: {'auction_closing_time': 1774716163.0, 'created_time': 1774510542.257214, 'last_price_update_time': 1774694861.313063}
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY58366') HTTP/1.1" 204 0
2026-03-28 10:47:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:41 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-28 10:47:41 [auto1.de] INFO: Scrape type for NV16003: 0
2026-03-28 10:47:41 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-28 10:47:41 [auto1.de] INFO: Scrape type for DS59487: 0
2026-03-28 10:47:41 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-28 10:47:41 [auto1.de] INFO: Scrape type for GJ17165: 0
2026-03-28 10:47:41 [auto1.de] INFO: Found listing with ID: YT23335
2026-03-28 10:47:41 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-28 10:47:41 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-28 10:47:41 [auto1.de] INFO: Scrape type for NH12576: 0
2026-03-28 10:47:41 [auto1.de] INFO: Found listing with ID: WD80617
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD80617%27 HTTP/1.1" 200 None
2026-03-28 10:47:41 [auto1.de] INFO: Scrape type for WD80617: 0
2026-03-28 10:47:41 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-28 10:47:41 [auto1.de] INFO: Found listing with ID: BX28873
2026-03-28 10:47:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:42 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: VK38709
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK38709%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for VK38709: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: JH99279
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH99279%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for JH99279: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: YR20535
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: RY66150
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61192%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for ZU61192: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: CJ93593
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for AJ62547: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for ZC42699: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: FW21815
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW21815%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for FW21815: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47451%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for EE47451: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: YL37879
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL37879%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for YL37879: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for SZ45535: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: MC30685
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC30685%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for MC30685: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: DL80875
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL80875%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for DL80875: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: AP12446
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: KE84614
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: VJ09038
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ09038%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for VJ09038: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: FD89715
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD89715%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for FD89715: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for FC97863: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: PF74105
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: ZX76617
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX76617%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for ZX76617: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: VH66319
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH66319%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for VH66319: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: ME61701
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME61701%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for ME61701: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: CW02492
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW02492%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for CW02492: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: PN40620
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: ER00491
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: PX22927
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX22927%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for PX22927: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: RY31497
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY31497%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for RY31497: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: NR66161
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR66161%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for NR66161: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for TT40648: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: JJ67232
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-28 10:47:42 [auto1.de] INFO: Scrape type for KA00227: 0
2026-03-28 10:47:42 [auto1.de] INFO: Found listing with ID: KZ45391
2026-03-28 10:47:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:43 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: PA67996
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA67996%27 HTTP/1.1" 200 None
2026-03-28 10:47:43 [auto1.de] INFO: Scrape type for PA67996: 0
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: VC74515
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC74515%27 HTTP/1.1" 200 None
2026-03-28 10:47:43 [auto1.de] INFO: Scrape type for VC74515: 0
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: WW75764
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW75764%27 HTTP/1.1" 200 None
2026-03-28 10:47:43 [auto1.de] INFO: Scrape type for WW75764: 0
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-28 10:47:43 [auto1.de] INFO: Scrape type for XF93739: 0
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: VS51720
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: BJ03544
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL60244%27 HTTP/1.1" 200 None
2026-03-28 10:47:43 [auto1.de] INFO: Scrape type for XL60244: 0
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: TZ46793
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ46793%27 HTTP/1.1" 200 None
2026-03-28 10:47:43 [auto1.de] INFO: Scrape type for TZ46793: 0
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: AJ07817
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: LR92682
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR92682%27 HTTP/1.1" 200 None
2026-03-28 10:47:43 [auto1.de] INFO: Scrape type for LR92682: 0
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: JP07657
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP07657%27 HTTP/1.1" 200 None
2026-03-28 10:47:43 [auto1.de] INFO: Scrape type for JP07657: 0
2026-03-28 10:47:43 [auto1.de] INFO: Found listing with ID: FA90244
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA90244%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for FA90244: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47334%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for NT47334: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: TS29154
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS29154%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for TS29154: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: WC76278
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC76278%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for WC76278: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: VB04886
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ01431%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for BZ01431: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: US78573
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for US78573: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ10280%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for YJ10280: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: CU60081
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU60081%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for CU60081: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: BB96456
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: AY98929
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: LJ65322
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65322%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for LJ65322: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56711%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for DJ56711: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: PH74270
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH74270%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for PH74270: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: ZX03854
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX03854%27 HTTP/1.1" 200 None
2026-03-28 10:47:44 [auto1.de] INFO: Scrape type for ZX03854: 0
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: RD09031
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: CZ43316
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: PB95967
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-28 10:47:44 [auto1.de] INFO: Found listing with ID: WD56041
2026-03-28 10:47:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:45 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: CT53281
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53281%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for CT53281: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: XE05025
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05025%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for XE05025: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: UF59044
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX92371%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for WX92371: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: KC84817
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC84817%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for KC84817: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: SH08334
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19219%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for UB19219: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: BM18767
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM18767%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for BM18767: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE72355%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for HE72355: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN69903%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for VN69903: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF65798%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for XF65798: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: CN60683
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: FD98026
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: AT70928
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT51313%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for JT51313: 0
2026-03-28 10:47:45 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-28 10:47:45 [auto1.de] INFO: Scrape type for AN45666: 2
2026-03-28 10:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1d60ed0-8eae-5229-9976-38e1e369d7f0 with identifier: AN45666
2026-03-28 10:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1d60ed0-8eae-5229-9976-38e1e369d7f0 with scrape type 2
2026-03-28 10:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1d60ed0-8eae-5229-9976-38e1e369d7f0 with scrape type 2
2026-03-28 10:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1d60ed0-8eae-5229-9976-38e1e369d7f0, identifier: AN45666
2026-03-28 10:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1d60ed0-8eae-5229-9976-38e1e369d7f0 with identifier: AN45666
2026-03-28 10:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1d60ed0-8eae-5229-9976-38e1e369d7f0 with identifier: AN45666
2026-03-28 10:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1d60ed0-8eae-5229-9976-38e1e369d7f0 with identifier: AN45666 to the API
2026-03-28 10:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:28:30Z',
 'fuel_type': 'petrol',
 'id': 'f1d60ed0-8eae-5229-9976-38e1e369d7f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN45666',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 75036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-05',
 'seller_name': None,
 'title': 'Audi A4 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Saving data for AN45666: {'auction_closing_time': 1774715310.0, 'created_time': 1773946574.7995, 'last_price_update_time': 1774694866.190742}
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN45666') HTTP/1.1" 204 0
2026-03-28 10:47:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for TT67137: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for DK51297: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: WX26579
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX26579%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for WX26579: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: ZH86268
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: DR46257
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR46257%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for DR46257: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC72019%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for XC72019: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for JG35367: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: TF67733
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF67733%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for TF67733: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: WC68946
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for DP00162: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: FA98642
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA98642%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for FA98642: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: XP88597
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: MC27583
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: RJ38519
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ38519%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for RJ38519: 0
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: JY58234
2026-03-28 10:47:46 [auto1.de] INFO: Found listing with ID: CA68070
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA68070%27 HTTP/1.1" 200 None
2026-03-28 10:47:46 [auto1.de] INFO: Scrape type for CA68070: 0
2026-03-28 10:47:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:47 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: TS97270
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS97270%27 HTTP/1.1" 200 None
2026-03-28 10:47:47 [auto1.de] INFO: Scrape type for TS97270: 0
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: UR35427
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: YY00170
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY00170%27 HTTP/1.1" 200 None
2026-03-28 10:47:47 [auto1.de] INFO: Scrape type for YY00170: 0
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: YW63189
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW63189%27 HTTP/1.1" 200 None
2026-03-28 10:47:47 [auto1.de] INFO: Scrape type for YW63189: 0
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-28 10:47:47 [auto1.de] INFO: Scrape type for LT13241: 0
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: KS68262
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: DL80467
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL80467%27 HTTP/1.1" 200 None
2026-03-28 10:47:47 [auto1.de] INFO: Scrape type for DL80467: 0
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-28 10:47:47 [auto1.de] INFO: Scrape type for YL76472: 0
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: LP13779
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP13779%27 HTTP/1.1" 200 None
2026-03-28 10:47:47 [auto1.de] INFO: Scrape type for LP13779: 0
2026-03-28 10:47:47 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for EK27182: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: RB24690
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: JA21059
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA21059%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for JA21059: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: MX11677
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11677%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for MX11677: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: XX85563
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85563%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for XX85563: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for SS51493: 2
2026-03-28 10:47:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fec73bf8-70b3-5287-93d5-5d1cecc98043 with identifier: SS51493
2026-03-28 10:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fec73bf8-70b3-5287-93d5-5d1cecc98043 with scrape type 2
2026-03-28 10:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fec73bf8-70b3-5287-93d5-5d1cecc98043 with scrape type 2
2026-03-28 10:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fec73bf8-70b3-5287-93d5-5d1cecc98043, identifier: SS51493
2026-03-28 10:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fec73bf8-70b3-5287-93d5-5d1cecc98043 with identifier: SS51493
2026-03-28 10:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fec73bf8-70b3-5287-93d5-5d1cecc98043 with identifier: SS51493
2026-03-28 10:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fec73bf8-70b3-5287-93d5-5d1cecc98043 with identifier: SS51493 to the API
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:39:56Z',
 'fuel_type': 'petrol',
 'id': 'fec73bf8-70b3-5287-93d5-5d1cecc98043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS51493',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 172944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Saving data for SS51493: {'auction_closing_time': 1774715996.0, 'created_time': 1773225544.729036, 'last_price_update_time': 1774694868.507694}
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS51493') HTTP/1.1" 204 0
2026-03-28 10:47:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: XE44885
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE44885%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for XE44885: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: PY07137
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35501%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for ZU35501: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: JX05743
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX05743%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for JX05743: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: WP32637
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for SG38319: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: BV43542
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: US71908
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71908%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for US71908: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: PU73316
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73316%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for PU73316: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: BY01569
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for LB77280: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: AV44518
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV44518%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for AV44518: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for UE92744: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: BG37416
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: JH74007
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH74007%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for JH74007: 0
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: NN39507
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-28 10:47:48 [auto1.de] INFO: Found listing with ID: ZV97129
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV97129%27 HTTP/1.1" 200 None
2026-03-28 10:47:48 [auto1.de] INFO: Scrape type for ZV97129: 0
2026-03-28 10:47:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:49 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: VK57644
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: VU62087
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: CR84704
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: ST72008
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: XU56057
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56057%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for XU56057: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: FU46952
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU46952%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for FU46952: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: HG52162
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: XP80923
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: TC50609
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: SN43229
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN43229%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for SN43229: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for RX17782: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ76956%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for JJ76956: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: BZ43252
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ43252%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for BZ43252: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: TH64703
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: AC00549
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC00549%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for AC00549: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: DF79170
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF79170%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for DF79170: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: PJ00212
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for YY60165: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: BP89276
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP89276%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for BP89276: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: BL42626
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: CE66063
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: BX01019
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01019%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for BX01019: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: KP49252
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: BJ62056
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: KJ62910
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ62910%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for KJ62910: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: YJ35877
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for YN11150: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for AE03495: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: NS67917
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for DG70282: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: JU71873
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU71873%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for JU71873: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: PZ79327
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ79327%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for PZ79327: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: DD55179
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: BJ16226
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ16226%27 HTTP/1.1" 200 None
2026-03-28 10:47:50 [auto1.de] INFO: Scrape type for BJ16226: 0
2026-03-28 10:47:50 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-28 10:47:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:51 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: CX80626
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: MX24097
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX24097%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for MX24097: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: SP79691
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP79691%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for SP79691: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: LU60211
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for YZ03964: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: GF01666
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for ED91782: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: DL96803
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: KA83204
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: DK56258
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: EH49621
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH49621%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for EH49621: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: YT14311
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT14311%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for YT14311: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: JG51855
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG51855%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for JG51855: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: GU42707
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU42707%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for GU42707: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: KE65935
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE65935%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for KE65935: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: BP81382
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: CN22310
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for HZ13557: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: HU80433
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: MG35847
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: ZB54249
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB54249%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for ZB54249: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: SW71463
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW71463%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for SW71463: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: NU50542
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU50542%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for NU50542: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: EP25363
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP25363%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for EP25363: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: CL49552
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL49552%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for CL49552: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for EW37787: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: MP85459
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP85459%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for MP85459: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: JY72572
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-28 10:47:51 [auto1.de] INFO: Scrape type for NS16825: 0
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-28 10:47:51 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-28 10:47:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:52 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for LU05399: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: FJ74023
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: NL55322
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY04572%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for FY04572: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for VX06445: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: GC35405
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC35405%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for GC35405: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for JJ29192: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: XM28055
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM28055%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for XM28055: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: SZ44736
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: TE88755
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: XM44045
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: SL38936
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: XJ41325
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41325%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for XJ41325: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: SW03993
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: SL19665
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: MT39473
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: SV83384
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: HN26382
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: AL74517
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: RJ03862
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: RB22775
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: DF48310
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for FD93722: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: YY19012
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for ZZ01082: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for DC51823: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78025%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for LD78025: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: AB33949
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: NS90051
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS90051%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for NS90051: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: BR94807
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR94807%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for BR94807: 0
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: SD77911
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: HK07166
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: AE50962
2026-03-28 10:47:52 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-28 10:47:52 [auto1.de] INFO: Scrape type for NZ25875: 0
2026-03-28 10:47:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:54 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC88789%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for HC88789: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for WZ27429: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: NP12620
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: NA24630
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA24630%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for NA24630: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for ZC43990: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: TD00729
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD57431%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for LD57431: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for ZY80421: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: FZ35057
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ35057%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for FZ35057: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for SJ63454: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: PP58013
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP58013%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for PP58013: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: GG43285
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG43285%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for GG43285: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: RX33159
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX33159%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for RX33159: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: PN00069
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN00069%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for PN00069: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for AY74749: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: JN73492
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN73492%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for JN73492: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: UY94475
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY94475%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for UY94475: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for SX50197: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: HY42291
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY42291%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for HY42291: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: WP34180
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34180%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for WP34180: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46959%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for WA46959: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: MH83701
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: VV35876
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV35876%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for VV35876: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: EH05548
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH05548%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for EH05548: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: UA33739
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA33739%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for UA33739: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: VN96863
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: AN16579
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: FX77489
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX77489%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for FX77489: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for SB28206: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: FK23500
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK23500%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for FK23500: 0
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: HR99158
2026-03-28 10:47:54 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY86490%27 HTTP/1.1" 200 None
2026-03-28 10:47:54 [auto1.de] INFO: Scrape type for HY86490: 0
2026-03-28 10:47:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:55 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35456%27 HTTP/1.1" 200 None
2026-03-28 10:47:55 [auto1.de] INFO: Scrape type for WJ35456: 0
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: XS00144
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS00144%27 HTTP/1.1" 200 None
2026-03-28 10:47:55 [auto1.de] INFO: Scrape type for XS00144: 0
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: AT81603
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: EX72075
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: FV97626
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV97626%27 HTTP/1.1" 200 None
2026-03-28 10:47:55 [auto1.de] INFO: Scrape type for FV97626: 0
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: RB55254
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: LT89703
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT89703%27 HTTP/1.1" 200 None
2026-03-28 10:47:55 [auto1.de] INFO: Scrape type for LT89703: 0
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: FC82550
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82550%27 HTTP/1.1" 200 None
2026-03-28 10:47:55 [auto1.de] INFO: Scrape type for FC82550: 0
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: PF15071
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: RL59137
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL59137%27 HTTP/1.1" 200 None
2026-03-28 10:47:55 [auto1.de] INFO: Scrape type for RL59137: 0
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: WG72441
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: AZ18369
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: MJ34390
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ34390%27 HTTP/1.1" 200 None
2026-03-28 10:47:55 [auto1.de] INFO: Scrape type for MJ34390: 0
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD21201%27 HTTP/1.1" 200 None
2026-03-28 10:47:55 [auto1.de] INFO: Scrape type for AD21201: 0
2026-03-28 10:47:55 [auto1.de] INFO: Found listing with ID: LC00841
2026-03-28 10:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC00841%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for LC00841: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: WX56329
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: DS97225
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS97225%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for DS97225: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: MH41234
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH41234%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for MH41234: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: AG42574
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG42574%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for AG42574: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: WA53567
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: VV73959
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: SF44435
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF44435%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for SF44435: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: YA96951
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: NC35073
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35073%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for NC35073: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: VU78858
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU78858%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for VU78858: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: CB59188
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB59188%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for CB59188: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: CM96643
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM96643%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for CM96643: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: TY15640
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: GX49972
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX49972%27 HTTP/1.1" 200 None
2026-03-28 10:47:56 [auto1.de] INFO: Scrape type for GX49972: 0
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: KS96797
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: SM55936
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: DD53059
2026-03-28 10:47:56 [auto1.de] INFO: Found listing with ID: LU87387
2026-03-28 10:47:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:57 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: SZ17598
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: GG45079
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: HB99974
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97980%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for YZ97980: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: ZA48754
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: RM29810
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM29810%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for RM29810: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: TN52823
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN52823%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for TN52823: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: FH96221
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: FP09706
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP09706%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for FP09706: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for BL21282: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77480%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for YA77480: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: PR94578
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: ZL92656
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL92656%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for ZL92656: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for ZN73895: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: BU43780
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU43780%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for BU43780: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26385%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for LN26385: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: ZF95436
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF95436%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for ZF95436: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: HA51828
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA51828%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for HA51828: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: XG30345
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: HR47989
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: FU29897
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: AH42647
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH42647%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for AH42647: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for AL34551: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for NL36228: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: FH96122
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH96122%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for FH96122: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: RC73620
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC73620%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for RC73620: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: KW02770
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: YH14948
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH14948%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for YH14948: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: YY11140
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: SY24934
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW77341%27 HTTP/1.1" 200 None
2026-03-28 10:47:57 [auto1.de] INFO: Scrape type for VW77341: 0
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: PD00491
2026-03-28 10:47:57 [auto1.de] INFO: Found listing with ID: RE68011
2026-03-28 10:47:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:47:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:47:58 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 9665 | hits on page: 40
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: HS45664
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA97720%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for GA97720: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: LC36947
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC36947%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for LC36947: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for NP46589: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: VT05900
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: AK10320
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK10320%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for AK10320: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: PG33349
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: AZ88481
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ88481%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for AZ88481: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: UJ65232
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ65232%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for UJ65232: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: DK90123
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: DV48088
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV48088%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for DV48088: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: AZ12624
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: MT86254
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR34047%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for GR34047: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: NW61921
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW61921%27 HTTP/1.1" 200 None
2026-03-28 10:47:58 [auto1.de] INFO: Scrape type for NW61921: 0
2026-03-28 10:47:58 [auto1.de] INFO: Found listing with ID: YP60462
2026-03-28 10:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP60462%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for YP60462: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: XW72193
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW72193%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for XW72193: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC77687%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for HC77687: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for JR17394: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP18966%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for FP18966: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: CS08298
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS08298%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for CS08298: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for MD58686: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: RT60437
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT60437%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for RT60437: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: SS72230
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS72230%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for SS72230: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: AW71127
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW71127%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for AW71127: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: BN04520
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN04520%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for BN04520: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: KH76596
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH76596%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for KH76596: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: MT34659
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for GV12841: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: KW21361
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: TS77277
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: EE13934
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE13934%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for EE13934: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR30493%27 HTTP/1.1" 200 None
2026-03-28 10:47:59 [auto1.de] INFO: Scrape type for UR30493: 0
2026-03-28 10:47:59 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-28 10:47:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:00 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for KU99299: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: TE34583
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE34583%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for TE34583: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: KA96977
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: LW41921
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: PV97314
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for KC01296: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: FN32159
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: AU19422
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: YC48203
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC48203%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for YC48203: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: XH77572
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH77572%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for XH77572: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: FT62764
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT62764%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for FT62764: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: ZJ19355
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: YL64188
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for MM26865: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: MY02609
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY02609%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for MY02609: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: SK50734
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for LV93529: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: FG94597
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG94597%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for FG94597: 0
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: ZP94489
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: ZA82143
2026-03-28 10:48:00 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-28 10:48:00 [auto1.de] INFO: Scrape type for LG94407: 2
2026-03-28 10:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with identifier: LG94407
2026-03-28 10:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with scrape type 2
2026-03-28 10:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with scrape type 2
2026-03-28 10:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7b9c088-c5d1-51e9-b3de-c86b44b4f347, identifier: LG94407
2026-03-28 10:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with identifier: LG94407
2026-03-28 10:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with identifier: LG94407
2026-03-28 10:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7b9c088-c5d1-51e9-b3de-c86b44b4f347 with identifier: LG94407 to the API
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:09:34Z',
 'fuel_type': 'petrol',
 'id': 'f7b9c088-c5d1-51e9-b3de-c86b44b4f347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG94407',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 106127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-08',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.3 TCe Energy BOSE-Edition',
 'transmission': 'manual',
 'trim': 'BOSE-Edition',
 'year': 2018}
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Saving data for LG94407: {'auction_closing_time': 1774714174.0, 'created_time': 1774510547.542065, 'last_price_update_time': 1774694881.528015}
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG94407') HTTP/1.1" 204 0
2026-03-28 10:48:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: CY68154
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY68154%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for CY68154: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for TE07006: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: FL38962
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL38962%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for FL38962: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: EK46666
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK46666%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for EK46666: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: RA23936
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: RU45291
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU45291%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for RU45291: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for SG68469: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: ZT67074
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT67074%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for ZT67074: 0
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-28 10:48:01 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-28 10:48:01 [auto1.de] INFO: Scrape type for PU90892: 0
2026-03-28 10:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:02 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: UM65045
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for GJ75374: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: YY27100
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: XP12912
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP12912%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for XP12912: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: KZ11902
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for CK59033: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69075%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for BP69075: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: KK88346
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK88346%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for KK88346: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: XG53445
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: XP11073
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP11073%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for XP11073: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: ZN09383
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN09383%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for ZN09383: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: VX77411
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX77411%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for VX77411: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: FG17963
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for CD05825: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: CZ50772
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: MA82024
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for VY22593: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: ZS98527
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS98527%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for ZS98527: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: LX19863
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU95957%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for FU95957: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: TX92372
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: SH68668
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: EN47002
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47002%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for EN47002: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: LV09393
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: RE90038
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE90038%27 HTTP/1.1" 200 None
2026-03-28 10:48:02 [auto1.de] INFO: Scrape type for RE90038: 0
2026-03-28 10:48:02 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR29139%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for JR29139: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: FJ00184
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: DB61618
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: FD50641
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: PC66618
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC66618%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for PC66618: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: VP49829
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: VP79611
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP79611%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for VP79611: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: LR43035
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR43035%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for LR43035: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: JZ88133
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ88133%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for JZ88133: 0
2026-03-28 10:48:03 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82983%27 HTTP/1.1" 200 None
2026-03-28 10:48:03 [auto1.de] INFO: Scrape type for MH82983: 0
2026-03-28 10:48:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:04 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: ZB28652
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB28652%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for ZB28652: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS73501%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for JS73501: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: HL11639
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL11639%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for HL11639: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: GZ60410
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: SS89558
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89558%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for SS89558: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: VA48219
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA48219%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for VA48219: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: KU60138
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: LP87124
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: MH16852
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH16852%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for MH16852: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: HS66299
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66299%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for HS66299: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: XH30445
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH30445%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for XH30445: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: PM30121
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: CU41994
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: ZZ39888
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ39888%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for ZZ39888: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: DP83508
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP83508%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for DP83508: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: AJ12624
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: EU54911
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: JE14755
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE14755%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for JE14755: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: XN43654
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN43654%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for XN43654: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for XE32981: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06535%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for CP06535: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: RU00171
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU00171%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for RU00171: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: FB69161
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB69161%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for FB69161: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: XB90815
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90815%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for XB90815: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: GC12583
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: CM42971
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25721%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for MJ25721: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: MG11664
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG11664%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for MG11664: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: NV18768
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: HM06155
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL52757%27 HTTP/1.1" 200 None
2026-03-28 10:48:04 [auto1.de] INFO: Scrape type for JL52757: 0
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: YW69752
2026-03-28 10:48:04 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-28 10:48:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:05 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-28 10:48:05 [auto1.de] INFO: Scrape type for MH48828: 0
2026-03-28 10:48:05 [auto1.de] INFO: Found listing with ID: RJ91019
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ91019%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for RJ91019: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: PM11705
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: NW48345
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW48345%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for NW48345: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: CC77808
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC77808%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for CC77808: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: AJ11776
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: CC84922
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC84922%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for CC84922: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for RS45157: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: CS22727
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: HT55645
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55645%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for HT55645: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: TJ17702
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ17702%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for TJ17702: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: WX42639
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX42639%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for WX42639: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: TE00128
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for BX62437: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for FG01299: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV92794%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for HV92794: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for FE62159: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: XZ20082
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ20082%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for XZ20082: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC16092%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for VC16092: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: AZ20598
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ20598%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for AZ20598: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: PK12624
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK12624%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for PK12624: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for DE54360: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: NU64349
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU64349%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for NU64349: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: MA95154
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: VM08251
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM08251%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for VM08251: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for BF92726: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV97177%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for SV97177: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: LS85848
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS85848%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for LS85848: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: MA92552
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA92552%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for MA92552: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90067%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for ND90067: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: WV31181
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: WP06272
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP06272%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for WP06272: 0
2026-03-28 10:48:06 [auto1.de] INFO: Found listing with ID: NV65753
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV65753%27 HTTP/1.1" 200 None
2026-03-28 10:48:06 [auto1.de] INFO: Scrape type for NV65753: 0
2026-03-28 10:48:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:06 [scrapy.extensions.logstats] INFO: Crawled 322 pages (at 30 pages/min), scraped 215 items (at 7 items/min)
2026-03-28 10:48:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:10 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 9665 | hits on page: 40
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: US20964
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US20964%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for US20964: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: YP19637
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP19637%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for YP19637: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: GG55912
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: LE07247
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: KE58425
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: UC67587
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67587%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for UC67587: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: MT37929
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: NN70157
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for JB33429: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: PB76080
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: ZZ70410
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: MB01512
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: JE38755
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE38755%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for JE38755: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for KH41700: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: DL07796
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: ZW75307
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM43405%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for KM43405: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for EC14916: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: RU20217
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: BK73994
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73994%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for BK73994: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: RH56837
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: CW66506
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW66506%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for CW66506: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for LG97713: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: NH37075
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for XP46424: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for FM24732: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: UC67308
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC67308%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for UC67308: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for LB09285: 0
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: RL82017
2026-03-28 10:48:10 [auto1.de] INFO: Found listing with ID: RE74325
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE74325%27 HTTP/1.1" 200 None
2026-03-28 10:48:10 [auto1.de] INFO: Scrape type for RE74325: 0
2026-03-28 10:48:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:27 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 9667 | hits on page: 40
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: RL82017
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: RE74325
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE74325%27 HTTP/1.1" 200 None
2026-03-28 10:48:27 [auto1.de] INFO: Scrape type for RE74325: 0
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-28 10:48:27 [auto1.de] INFO: Scrape type for CS13699: 0
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: AC78646
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC78646%27 HTTP/1.1" 200 None
2026-03-28 10:48:27 [auto1.de] INFO: Scrape type for AC78646: 0
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: WT87490
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: LS17715
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS17715%27 HTTP/1.1" 200 None
2026-03-28 10:48:27 [auto1.de] INFO: Scrape type for LS17715: 0
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: AZ58179
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ58179%27 HTTP/1.1" 200 None
2026-03-28 10:48:27 [auto1.de] INFO: Scrape type for AZ58179: 0
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: LY90714
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: DF13757
2026-03-28 10:48:27 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH97697%27 HTTP/1.1" 200 None
2026-03-28 10:48:27 [auto1.de] INFO: Scrape type for HH97697: 2
2026-03-28 10:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697
2026-03-28 10:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd7af8d-0401-5559-b238-fc39f2b61e82 with scrape type 2
2026-03-28 10:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dd7af8d-0401-5559-b238-fc39f2b61e82 with scrape type 2
2026-03-28 10:48:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dd7af8d-0401-5559-b238-fc39f2b61e82, identifier: HH97697
2026-03-28 10:48:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697
2026-03-28 10:48:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697
2026-03-28 10:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697 to the API
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:33:25Z',
 'fuel_type': 'diesel',
 'id': '6dd7af8d-0401-5559-b238-fc39f2b61e82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH97697',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 32223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-03',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH97697%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Saving data for HH97697: {'auction_closing_time': 1774715605.0, 'created_time': 1773305582.788663, 'last_price_update_time': 1774694908.38525}
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH97697') HTTP/1.1" 204 0
2026-03-28 10:48:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: AA51268
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for UY74953: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ29670%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for JZ29670: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: UJ05143
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for GS82653: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for PE27175: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for AZ40865: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY54075%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for RY54075: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: ZX49243
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX49243%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for ZX49243: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: SH34728
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34728%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for SH34728: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: ZZ68403
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: SZ88186
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ88186%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for SZ88186: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: DL39221
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL39221%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for DL39221: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: WZ31189
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: RS00302
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS00302%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for RS00302: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: TU46947
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for VV79476: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: DN68550
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN68550%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for DN68550: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: JW69458
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: SC69057
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC69057%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for SC69057: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: ST98155
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: CR90100
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: HX20102
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX20102%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for HX20102: 0
2026-03-28 10:48:28 [auto1.de] INFO: Found listing with ID: LS81640
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS81640%27 HTTP/1.1" 200 None
2026-03-28 10:48:28 [auto1.de] INFO: Scrape type for LS81640: 0
2026-03-28 10:48:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:32 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 9668 | hits on page: 40
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: LS81640
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS81640%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for LS81640: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HG98131
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG98131%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for HG98131: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08080%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for AE08080: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: JU56361
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for PK47596: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for PY46067: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for BJ29098: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: FW67106
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: BG13362
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for RF22787: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HM53441
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM53441%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for HM53441: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: JT68679
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT68679%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for JT68679: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: UC16251
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for MT59111: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: JH03969
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH03969%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for JH03969: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HZ59997
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ59997%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for HZ59997: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: DN67284
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for SV23538: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: VS07108
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: CV73589
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73589%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for CV73589: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49707%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for RT49707: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: ND37325
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for ED94101: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: DP75483
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP75483%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for DP75483: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HX17640
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX17640%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for HX17640: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: NU59007
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU59007%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for NU59007: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: AD58556
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD58556%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for AD58556: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: XW64211
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64211%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for XW64211: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HN56676
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN56676%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for HN56676: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-28 10:48:32 [auto1.de] INFO: Scrape type for NK37699: 0
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-28 10:48:32 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-28 10:48:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:39 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 9668 | hits on page: 40
2026-03-28 10:48:39 [auto1.de] INFO: Found listing with ID: UD93265
2026-03-28 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD93265%27 HTTP/1.1" 200 None
2026-03-28 10:48:39 [auto1.de] INFO: Scrape type for UD93265: 0
2026-03-28 10:48:39 [auto1.de] INFO: Found listing with ID: RE14454
2026-03-28 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE14454%27 HTTP/1.1" 200 None
2026-03-28 10:48:39 [auto1.de] INFO: Scrape type for RE14454: 0
2026-03-28 10:48:39 [auto1.de] INFO: Found listing with ID: DP99201
2026-03-28 10:48:39 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-28 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-28 10:48:39 [auto1.de] INFO: Scrape type for NY81856: 0
2026-03-28 10:48:39 [auto1.de] INFO: Found listing with ID: BR35600
2026-03-28 10:48:39 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-28 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88330%27 HTTP/1.1" 200 None
2026-03-28 10:48:39 [auto1.de] INFO: Scrape type for ZE88330: 0
2026-03-28 10:48:39 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-28 10:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for MC57954: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98772%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for KG98772: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: RZ67048
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ67048%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for RZ67048: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: MG85593
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG85593%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for MG85593: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: FB64910
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: KN24500
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: RU77143
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU77143%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for RU77143: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: CP51565
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP51565%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for CP51565: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: BE71150
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: GB40015
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB40015%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for GB40015: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: HJ82357
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for SS59240: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT59305%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for UT59305: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: JK15259
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK15259%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for JK15259: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: RV63861
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV63861%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for RV63861: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: PL20844
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: ZG66499
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: KL17270
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL17270%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for KL17270: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for XD50788: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL75204%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for VL75204: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18801%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for BY18801: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: CC51739
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: ZL98150
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98150%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for ZL98150: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: PL06364
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL06364%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for PL06364: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: EG86268
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: NF90581
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF90581%27 HTTP/1.1" 200 None
2026-03-28 10:48:40 [auto1.de] INFO: Scrape type for NF90581: 0
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: VZ02719
2026-03-28 10:48:40 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-28 10:48:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:49 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 9670 | hits on page: 40
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: VZ02719
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for PG96137: 0
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for WV38848: 0
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: GZ66698
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ66698%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for GZ66698: 0
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: DK78572
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for GX28379: 0
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: PE88762
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: TW63650
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63650%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for TW63650: 0
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for DX51383: 0
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: AU05759
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: HM98480
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: UP04235
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP04235%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for UP04235: 0
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: BN05561
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05561%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for BN05561: 0
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: BA46324
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA46324%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for BA46324: 0
2026-03-28 10:48:49 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-28 10:48:49 [auto1.de] INFO: Scrape type for KS48100: 2
2026-03-28 10:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15d002de-27ad-5867-8e62-144a3fca40bb with identifier: KS48100
2026-03-28 10:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15d002de-27ad-5867-8e62-144a3fca40bb with scrape type 2
2026-03-28 10:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15d002de-27ad-5867-8e62-144a3fca40bb with scrape type 2
2026-03-28 10:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15d002de-27ad-5867-8e62-144a3fca40bb, identifier: KS48100
2026-03-28 10:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15d002de-27ad-5867-8e62-144a3fca40bb with identifier: KS48100
2026-03-28 10:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15d002de-27ad-5867-8e62-144a3fca40bb with identifier: KS48100
2026-03-28 10:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15d002de-27ad-5867-8e62-144a3fca40bb with identifier: KS48100 to the API
2026-03-28 10:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:54:52Z',
 'fuel_type': 'petrol',
 'id': '15d002de-27ad-5867-8e62-144a3fca40bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS48100',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 30291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-13',
 'seller_name': None,
 'title': 'MINI Cooper S Favoured Trim',
 'transmission': 'automatic',
 'trim': 'Favoured Trim',
 'year': 2024}
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Saving data for KS48100: {'auction_closing_time': 1774716892.0, 'created_time': 1774510545.457493, 'last_price_update_time': 1774694930.218264}
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS48100') HTTP/1.1" 204 0
2026-03-28 10:48:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: EP52094
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP52094%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Scrape type for EP52094: 0
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: SR37454
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW76305%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Scrape type for YW76305: 0
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: XA77724
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA77724%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Scrape type for XA77724: 0
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: WF16279
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: FR35172
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR35172%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Scrape type for FR35172: 0
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: FT74133
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: UB38135
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB38135%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Scrape type for UB38135: 0
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: PV29285
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: XZ91818
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: EV41055
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: ME37510
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: JC38309
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: WS06283
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: BF71090
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF71090%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Scrape type for BF71090: 0
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Scrape type for WX30438: 0
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: GU34646
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU34646%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Scrape type for GU34646: 0
2026-03-28 10:48:50 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ43779%27 HTTP/1.1" 200 None
2026-03-28 10:48:50 [auto1.de] INFO: Scrape type for AJ43779: 0
2026-03-28 10:48:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:52 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 9670 | hits on page: 40
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: VE89968
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE89968%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for VE89968: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for GR33012: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: CE62650
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE62650%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for CE62650: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN30435%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for LN30435: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: HE47974
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: KF09771
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: PT72928
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT72928%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for PT72928: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: KR79365
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: FC01823
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC01823%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for FC01823: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85810%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for ZS85810: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: YG55269
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG55269%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for YG55269: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for JV66840: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH52660%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for RH52660: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: XN01413
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN01413%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for XN01413: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: SL85430
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL85430%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for SL85430: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: AA89468
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: BH73994
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH73994%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for BH73994: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54065%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for HH54065: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT54414%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for NT54414: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: CK74950
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK74950%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for CK74950: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for NH53597: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: AB52853
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB52853%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for AB52853: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: KU59477
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU59477%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for KU59477: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: RW72684
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72684%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for RW72684: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for PN56757: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for RW26653: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: DM43280
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: MU10500
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU10500%27 HTTP/1.1" 200 None
2026-03-28 10:48:52 [auto1.de] INFO: Scrape type for MU10500: 0
2026-03-28 10:48:52 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-28 10:48:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:48:59 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 9670 | hits on page: 40
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for SG08680: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: EZ01332
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: MJ74950
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: LM68672
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: ZS20777
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: ZM93791
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM93791%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for ZM93791: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: DC48587
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: KV44298
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV44298%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for KV44298: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: XM74841
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM74841%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for XM74841: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: GF12602
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF12602%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for GF12602: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: GH70383
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH70383%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for GH70383: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for CX46071: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: DE53161
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: KE44581
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE44581%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for KE44581: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: LE29079
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE29079%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for LE29079: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: NJ97251
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: GB19740
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: ZM05379
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: WM92411
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92411%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for WM92411: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: PE04478
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE04478%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for PE04478: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD59606%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for UD59606: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: EL74738
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: LS45558
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS45558%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for LS45558: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72681%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for SJ72681: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: GW29634
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: DW74206
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW74206%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for DW74206: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: PP35153
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP35153%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for PP35153: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for GT24864: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: WY46685
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for FW07623: 0
2026-03-28 10:48:59 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-28 10:48:59 [auto1.de] INFO: Scrape type for EY26571: 0
2026-03-28 10:48:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:01 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: SZ79532
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ79532%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for SZ79532: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17633%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for RT17633: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: XS36937
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS36937%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for XS36937: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: DH78360
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH78360%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for DH78360: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for BM31151: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: KX36775
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX36775%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for KX36775: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: JM32956
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM32956%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for JM32956: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: RR06501
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: GJ44071
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ44071%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for GJ44071: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: RP55300
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP55300%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for RP55300: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: YR53250
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: JM90464
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ98197%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for AJ98197: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE62797%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for DE62797: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: YU90808
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: NE09834
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE09834%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for NE09834: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: XU78449
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU78449%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for XU78449: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: WG42712
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG42712%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for WG42712: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for XF30370: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: FD43857
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: UR23354
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: UX96397
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX96397%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for UX96397: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD28081%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for MD28081: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for DF94308: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: HH37576
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH37576%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for HH37576: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: NX83619
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: WE84338
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: FA30463
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA30463%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for FA30463: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: WZ70999
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: KX20208
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX20208%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for KX20208: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE75609%27 HTTP/1.1" 200 None
2026-03-28 10:49:01 [auto1.de] INFO: Scrape type for CE75609: 0
2026-03-28 10:49:01 [auto1.de] INFO: Found listing with ID: BS12616
2026-03-28 10:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS12616%27 HTTP/1.1" 200 None
2026-03-28 10:49:02 [auto1.de] INFO: Scrape type for BS12616: 0
2026-03-28 10:49:02 [auto1.de] INFO: Found listing with ID: DM53620
2026-03-28 10:49:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:04 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: HY95420
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY95420%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for HY95420: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: WT92496
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92496%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for WT92496: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: SK78109
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: PJ80384
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: BR45511
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: TS77331
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: RK36338
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK36338%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for RK36338: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: SE81381
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: TW05114
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for LN34178: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: BH71289
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: VP41401
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: RB35490
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY93423%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for MY93423: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for WG27498: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: US80699
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: GB62942
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB62942%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for GB62942: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: LL54952
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL54952%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for LL54952: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: DU80644
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU80644%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for DU80644: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: YG98793
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG98793%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for YG98793: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: ZN92027
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN92027%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for ZN92027: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB14031%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for SB14031: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: HG78965
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: UH62107
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: AT99674
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT99674%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for AT99674: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: DE48609
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: WG52283
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for MU38011: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for CR61198: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: DZ26668
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26668%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for DZ26668: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: PP69489
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: FX85164
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX85164%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for FX85164: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: MD91791
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD91791%27 HTTP/1.1" 200 None
2026-03-28 10:49:04 [auto1.de] INFO: Scrape type for MD91791: 0
2026-03-28 10:49:04 [auto1.de] INFO: Found listing with ID: WE14198
2026-03-28 10:49:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:06 [scrapy.extensions.logstats] INFO: Crawled 331 pages (at 9 pages/min), scraped 217 items (at 2 items/min)
2026-03-28 10:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:49:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:08 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: BX93358
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX93358%27 HTTP/1.1" 200 None
2026-03-28 10:49:08 [auto1.de] INFO: Scrape type for BX93358: 0
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: BF99828
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-28 10:49:08 [auto1.de] INFO: Scrape type for KJ44451: 0
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: KD44846
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-28 10:49:08 [auto1.de] INFO: Scrape type for MU97238: 0
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: KP26466
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP26466%27 HTTP/1.1" 200 None
2026-03-28 10:49:08 [auto1.de] INFO: Scrape type for KP26466: 0
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-28 10:49:08 [auto1.de] INFO: Scrape type for SD16829: 0
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY49734%27 HTTP/1.1" 200 None
2026-03-28 10:49:08 [auto1.de] INFO: Scrape type for XY49734: 0
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: TM93918
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE82761%27 HTTP/1.1" 200 None
2026-03-28 10:49:08 [auto1.de] INFO: Scrape type for FE82761: 0
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: UH39337
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: VF58468
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: GN34545
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF56561%27 HTTP/1.1" 200 None
2026-03-28 10:49:08 [auto1.de] INFO: Scrape type for DF56561: 0
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: AX05143
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-28 10:49:08 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-28 10:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM64069%27 HTTP/1.1" 200 None
2026-03-28 10:49:09 [auto1.de] INFO: Scrape type for MM64069: 0
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: NV66174
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-28 10:49:09 [auto1.de] INFO: Scrape type for EU27466: 0
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: SP32768
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: BG47316
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG47316%27 HTTP/1.1" 200 None
2026-03-28 10:49:09 [auto1.de] INFO: Scrape type for BG47316: 0
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: BU31051
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU31051%27 HTTP/1.1" 200 None
2026-03-28 10:49:09 [auto1.de] INFO: Scrape type for BU31051: 0
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: TE51742
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE51742%27 HTTP/1.1" 200 None
2026-03-28 10:49:09 [auto1.de] INFO: Scrape type for TE51742: 0
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: RG99680
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG99680%27 HTTP/1.1" 200 None
2026-03-28 10:49:09 [auto1.de] INFO: Scrape type for RG99680: 0
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: AX75874
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: GS24649
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS24649%27 HTTP/1.1" 200 None
2026-03-28 10:49:09 [auto1.de] INFO: Scrape type for GS24649: 0
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: RS08220
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-28 10:49:09 [auto1.de] INFO: Scrape type for MV56275: 0
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: LZ64363
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: NA10756
2026-03-28 10:49:09 [auto1.de] INFO: Found listing with ID: VA23337
2026-03-28 10:49:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:16 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: ED87662
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED87662%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for ED87662: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: ZT91138
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: BR62242
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR62242%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for BR62242: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: ND31519
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND31519%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for ND31519: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB29224%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for EB29224: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: WS70576
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: MU06950
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06950%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for MU06950: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: GL43025
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL43025%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for GL43025: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: LR55805
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: CG60356
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG60356%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for CG60356: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: NC69837
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: WK00710
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for ZR08367: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06665%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for BW06665: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: BV90927
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV90927%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for BV90927: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: LD74655
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: AU29574
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29574%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for AU29574: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: LM65356
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: LE59540
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for ME72354: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: KJ04555
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ04555%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for KJ04555: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: PR68171
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR68171%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for PR68171: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: GA84874
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA84874%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for GA84874: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for WW51915: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK09609%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for NK09609: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: NH48302
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: FU90686
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90686%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for FU90686: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for LR95574: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: VZ82726
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: CS72322
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: ZR98905
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98905%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for ZR98905: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for EL53532: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: JN87452
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN87452%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for JN87452: 0
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: EZ97284
2026-03-28 10:49:16 [auto1.de] INFO: Found listing with ID: SJ63843
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63843%27 HTTP/1.1" 200 None
2026-03-28 10:49:16 [auto1.de] INFO: Scrape type for SJ63843: 0
2026-03-28 10:49:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:33 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:33 [auto1.de] INFO: Found listing with ID: VZ68210
2026-03-28 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ68210%27 HTTP/1.1" 200 None
2026-03-28 10:49:33 [auto1.de] INFO: Scrape type for VZ68210: 0
2026-03-28 10:49:33 [auto1.de] INFO: Found listing with ID: PM53589
2026-03-28 10:49:33 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-28 10:49:33 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-28 10:49:33 [auto1.de] INFO: Found listing with ID: GM26241
2026-03-28 10:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM26241%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for GM26241: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for BE80399: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: RE64709
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: AJ85429
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH84474%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for LH84474: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: CL77632
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL77632%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for CL77632: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: PJ34176
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: GA94662
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA94662%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for GA94662: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: CT29846
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: PM22977
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for PG24274: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: ED27900
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: XW75197
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: LA89414
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA89414%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for LA89414: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: VW14529
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW14529%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for VW14529: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: MV76572
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV76572%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for MV76572: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: KY77386
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY77386%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for KY77386: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE06850%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for HE06850: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: RU20200
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: PW87912
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW87912%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for PW87912: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: TX62945
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX62945%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for TX62945: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: SR33792
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33792%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for SR33792: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: VK33233
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK33233%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for VK33233: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: VW53708
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for GH07682: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: VA97546
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: BG60568
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: HP43696
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP43696%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for HP43696: 0
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-28 10:49:34 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-28 10:49:34 [auto1.de] INFO: Scrape type for MB83489: 0
2026-03-28 10:49:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:35 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 9670 | hits on page: 40
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: KH64272
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH64272%27 HTTP/1.1" 200 None
2026-03-28 10:49:35 [auto1.de] INFO: Scrape type for KH64272: 0
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: DP86097
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP86097%27 HTTP/1.1" 200 None
2026-03-28 10:49:35 [auto1.de] INFO: Scrape type for DP86097: 0
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: TF55396
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18846%27 HTTP/1.1" 200 None
2026-03-28 10:49:35 [auto1.de] INFO: Scrape type for KV18846: 0
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: BS18924
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS18924%27 HTTP/1.1" 200 None
2026-03-28 10:49:35 [auto1.de] INFO: Scrape type for BS18924: 0
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-28 10:49:35 [auto1.de] INFO: Scrape type for CY25945: 0
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: DH62820
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH62820%27 HTTP/1.1" 200 None
2026-03-28 10:49:35 [auto1.de] INFO: Scrape type for DH62820: 0
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: SL64623
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: SZ82893
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ82893%27 HTTP/1.1" 200 None
2026-03-28 10:49:35 [auto1.de] INFO: Scrape type for SZ82893: 0
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: NB86362
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB86362%27 HTTP/1.1" 200 None
2026-03-28 10:49:35 [auto1.de] INFO: Scrape type for NB86362: 0
2026-03-28 10:49:35 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-28 10:49:35 [auto1.de] INFO: Scrape type for AM60777: 2
2026-03-28 10:49:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5583474a-661d-57c3-a843-cbaa4f44267f with identifier: AM60777
2026-03-28 10:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5583474a-661d-57c3-a843-cbaa4f44267f with scrape type 2
2026-03-28 10:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5583474a-661d-57c3-a843-cbaa4f44267f with scrape type 2
2026-03-28 10:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5583474a-661d-57c3-a843-cbaa4f44267f, identifier: AM60777
2026-03-28 10:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5583474a-661d-57c3-a843-cbaa4f44267f with identifier: AM60777
2026-03-28 10:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5583474a-661d-57c3-a843-cbaa4f44267f with identifier: AM60777
2026-03-28 10:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5583474a-661d-57c3-a843-cbaa4f44267f with identifier: AM60777 to the API
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:52Z',
 'fuel_type': 'diesel',
 'id': '5583474a-661d-57c3-a843-cbaa4f44267f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM60777',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 154026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2017}
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Saving data for AM60777: {'auction_closing_time': 1774716232.0, 'created_time': 1774510532.068707, 'last_price_update_time': 1774694976.523246}
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM60777') HTTP/1.1" 204 0
2026-03-28 10:49:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: SK30483
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: WT98226
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT98226%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for WT98226: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: WW97819
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: UN48068
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: MH25393
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH25393%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for MH25393: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR72775%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for SR72775: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: NF21542
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: YG95815
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for PA80529: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: GZ27207
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ27207%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for GZ27207: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: BH72065
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH72065%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for BH72065: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for CY45921: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75673%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for LN75673: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: YP78886
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG82433%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for GG82433: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: US88233
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: AL03330
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06694%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for HH06694: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: HA17453
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: UE28528
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28528%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for UE28528: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: PP91103
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: PY54306
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY54306%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for PY54306: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: JH65872
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT22641%27 HTTP/1.1" 200 None
2026-03-28 10:49:36 [auto1.de] INFO: Scrape type for CT22641: 0
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-28 10:49:36 [auto1.de] INFO: Found listing with ID: SY63784
2026-03-28 10:49:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:40 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 9671 | hits on page: 40
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: SY63784
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: EX64798
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX64798%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for EX64798: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: WY14478
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY14478%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for WY14478: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: KP36824
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP36824%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for KP36824: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: XM84350
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: FH12952
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: DL87338
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: KX39833
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX39833%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for KX39833: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: CC31467
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: ZM02354
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: JA10385
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA10385%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for JA10385: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: DG26223
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG26223%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for DG26223: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM50859%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for CM50859: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: ZM31431
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: KW13573
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: EE01889
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: FD10319
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD10319%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for FD10319: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: SK44857
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK44857%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for SK44857: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for ZP35673: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42521%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for BZ42521: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: FK25443
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: FS70562
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: UK82813
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK82813%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for UK82813: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: XY75153
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: HS46985
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: JU05593
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA30528%27 HTTP/1.1" 200 None
2026-03-28 10:49:40 [auto1.de] INFO: Scrape type for UA30528: 0
2026-03-28 10:49:40 [auto1.de] INFO: Found listing with ID: LN75717
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75717%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for LN75717: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: CA34591
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for ZN40502: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: ZT31160
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT31160%27 HTTP/1.1" 200 None
2026-03-28 10:49:41 [auto1.de] INFO: Scrape type for ZT31160: 0
2026-03-28 10:49:41 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-28 10:49:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:42 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 9671 | hits on page: 40
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: JJ00405
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: TY80313
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY80313%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for TY80313: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: RP79325
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: MU08811
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: BH79030
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: BB60777
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB60777%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for BB60777: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: JP78451
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP78451%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for JP78451: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: AG20717
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG20717%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for AG20717: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW98108%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for GW98108: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: CH88206
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: KP40091
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: SX62483
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX62483%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for SX62483: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64336%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for FT64336: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: UW75870
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW75870%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for UW75870: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: NC84547
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC84547%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for NC84547: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: UR62816
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR62816%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for UR62816: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: LC00644
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC00644%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for LC00644: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: SX42326
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX42326%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for SX42326: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: JB63291
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB63291%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for JB63291: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: BE29986
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10648%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for VY10648: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: UE64486
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: WW56601
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD01626%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for LD01626: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: NM87111
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM87111%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for NM87111: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for HX36326: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for YV66765: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: UP64202
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for RN84486: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: UC78818
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78818%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for UC78818: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: VA46995
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA46995%27 HTTP/1.1" 200 None
2026-03-28 10:49:42 [auto1.de] INFO: Scrape type for VA46995: 0
2026-03-28 10:49:42 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-28 10:49:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:48 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 9672 | hits on page: 40
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: FR76409
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: EW53480
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: KN86570
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN86570%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for KN86570: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: YB59373
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: LL77007
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL77007%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for LL77007: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: CH65115
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH65115%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for CH65115: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: XV72544
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: CY78505
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50693%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for SB50693: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL37483%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for PL37483: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: KR09634
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: XD09814
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD09814%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for XD09814: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: BF67305
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF67305%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for BF67305: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: AD64899
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD64899%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for AD64899: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: LK57603
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK57603%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for LK57603: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for CV84531: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: PK80050
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK80050%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for PK80050: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE50334%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for JE50334: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: UN95806
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN95806%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for UN95806: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for ZB59934: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: GU98415
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: GJ43799
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ43799%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for GJ43799: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: XV29391
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV29391%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for XV29391: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: SC29196
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC29196%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for SC29196: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: LP17470
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: XJ94036
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ94036%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for XJ94036: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN52671%27 HTTP/1.1" 200 None
2026-03-28 10:49:48 [auto1.de] INFO: Scrape type for PN52671: 0
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-28 10:49:48 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-28 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-28 10:49:49 [auto1.de] INFO: Scrape type for TB42941: 0
2026-03-28 10:49:49 [auto1.de] INFO: Found listing with ID: XE74160
2026-03-28 10:49:49 [auto1.de] INFO: Found listing with ID: DP90714
2026-03-28 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90714%27 HTTP/1.1" 200 None
2026-03-28 10:49:49 [auto1.de] INFO: Scrape type for DP90714: 0
2026-03-28 10:49:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:50 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 9672 | hits on page: 40
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX54291%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for AX54291: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for GY49475: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: JL28573
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL28573%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for JL28573: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN77195%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for NN77195: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: CK75631
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK75631%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for CK75631: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: ZR47880
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR47880%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for ZR47880: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: DX70553
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: PT89540
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT89540%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for PT89540: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: AT83868
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: CY41602
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY41602%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for CY41602: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: KF01282
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF01282%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for KF01282: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: EA51834
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA51834%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for EA51834: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: SH57495
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: HX02053
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: HJ19382
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ19382%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for HJ19382: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: GK12376
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK12376%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for GK12376: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: DE15792
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for RZ14311: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: YC07614
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: VW16070
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW16070%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for VW16070: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: EG70840
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: TW42181
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: HZ36583
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ36583%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for HZ36583: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: HU95530
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: DB47248
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB47248%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for DB47248: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77152%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for HL77152: 0
2026-03-28 10:49:50 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY00065%27 HTTP/1.1" 200 None
2026-03-28 10:49:50 [auto1.de] INFO: Scrape type for PY00065: 2
2026-03-28 10:49:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with identifier: PY00065
2026-03-28 10:49:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with scrape type 2
2026-03-28 10:49:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with scrape type 2
2026-03-28 10:49:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747, identifier: PY00065
2026-03-28 10:49:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with identifier: PY00065
2026-03-28 10:49:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with identifier: PY00065
2026-03-28 10:49:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747 with identifier: PY00065 to the API
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:49:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:23:31Z',
 'fuel_type': 'petrol',
 'id': '1e5a0020-1a1a-5ba8-b782-fcdd6c2d2747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY00065',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 148176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-09',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2011}
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY00065%27 HTTP/1.1" 200 None
2026-03-28 10:49:51 [auto1.de] INFO: Saving data for PY00065: {'auction_closing_time': 1774715011.0, 'created_time': 1773303034.195269, 'last_price_update_time': 1774694991.293151}
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY00065') HTTP/1.1" 204 0
2026-03-28 10:49:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:49:51 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-28 10:49:51 [auto1.de] INFO: Found listing with ID: FT13435
2026-03-28 10:49:51 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-28 10:49:51 [auto1.de] INFO: Scrape type for TM90896: 0
2026-03-28 10:49:51 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-28 10:49:51 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-28 10:49:51 [auto1.de] INFO: Scrape type for VL50005: 0
2026-03-28 10:49:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:49:58 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 9672 | hits on page: 40
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for KH87635: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for BG27909: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: KR15967
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15967%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for KR15967: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: FL13933
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43350%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for ZU43350: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: UG79449
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX05236%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for EX05236: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: MF18301
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: EY99757
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: KJ94433
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: SY52709
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: GC15327
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: PC96089
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS29776%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for ZS29776: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: GW32993
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW32993%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for GW32993: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: ZE91614
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE91614%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for ZE91614: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: MD38661
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD38661%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for MD38661: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: LW74577
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW74577%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for LW74577: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for BE10482: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: DA94168
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA94168%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for DA94168: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for KV18345: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: CS67228
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS67228%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for CS67228: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX23158%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for XX23158: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: AP69664
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP69664%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for AP69664: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL59024%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for LL59024: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: CZ73212
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: EV67878
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: SP13304
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: CX40237
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: CK60135
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for XS27718: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: KT50615
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for KY70270: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: VD25373
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:49:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD25373%27 HTTP/1.1" 200 None
2026-03-28 10:49:58 [auto1.de] INFO: Scrape type for VD25373: 0
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-28 10:49:58 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-28 10:49:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:06 [scrapy.extensions.logstats] INFO: Crawled 341 pages (at 10 pages/min), scraped 219 items (at 2 items/min)
2026-03-28 10:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:50:06 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: CR67511
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR67511%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for CR67511: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: RT10387
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10387%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for RT10387: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: TF12551
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: NA95375
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: CY33592
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: HF35656
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35656%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for HF35656: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58074%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for LJ58074: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: FU70567
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78889%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for RX78889: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY18465%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for YY18465: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: RA78002
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA78002%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for RA78002: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: DK74587
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK74587%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for DK74587: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: UT06922
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for EW76820: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: NY29547
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: AS57198
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: AK11207
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK11207%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for AK11207: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: WM78978
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: AV68122
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: AX02207
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: ZY72321
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72321%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for ZY72321: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: AS95642
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: LN37721
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN37721%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for LN37721: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: FN85250
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85250%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for FN85250: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: CB57025
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: YF69717
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF69717%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for YF69717: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: VT62851
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT62851%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for VT62851: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: WW96945
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: JD69388
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70532%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for DM70532: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: RL18090
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL18090%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for RL18090: 0
2026-03-28 10:50:06 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-28 10:50:06 [auto1.de] INFO: Scrape type for SS30943: 0
2026-03-28 10:50:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:07 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: BS00232
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: FT69115
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT69115%27 HTTP/1.1" 200 None
2026-03-28 10:50:07 [auto1.de] INFO: Scrape type for FT69115: 0
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: TW55343
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW55343%27 HTTP/1.1" 200 None
2026-03-28 10:50:07 [auto1.de] INFO: Scrape type for TW55343: 0
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: WC00524
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: ZV20362
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV20362%27 HTTP/1.1" 200 None
2026-03-28 10:50:07 [auto1.de] INFO: Scrape type for ZV20362: 0
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-28 10:50:07 [auto1.de] INFO: Scrape type for XA52388: 0
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: KU28834
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-28 10:50:07 [auto1.de] INFO: Scrape type for AB05978: 0
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-28 10:50:07 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB95476%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for XB95476: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: BU12505
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: GL77539
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL77539%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for GL77539: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: VZ65007
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: MF25653
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: GW56930
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW56930%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for GW56930: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC31762%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for MC31762: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for HT41484: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: TL37084
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL37084%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for TL37084: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for TW05581: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: RD14562
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD14562%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for RD14562: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for FB48782: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for BE47693: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS17931%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for HS17931: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: YC46871
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC46871%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for YC46871: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: VZ15910
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15910%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for VZ15910: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: HU58633
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU58633%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for HU58633: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for CF91602: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for YZ29676: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN47186%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for MN47186: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: FF65657
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: WM87026
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM87026%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for WM87026: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-28 10:50:08 [auto1.de] INFO: Scrape type for KF98082: 0
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: FE80519
2026-03-28 10:50:08 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-28 10:50:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:11 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: HX41929
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX41929%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for HX41929: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: YY13895
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: SS50589
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS50589%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for SS50589: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: JJ00785
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ00785%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for JJ00785: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: GK14765
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: RC56290
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: XU63236
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: UH34281
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: DX28979
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX28979%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for DX28979: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: DF27439
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: JN60731
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN60731%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for JN60731: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: LX06278
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: ZA89308
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA89308%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for ZA89308: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: ZA98162
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA98162%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for ZA98162: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: WS06439
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for JE63209: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: CH96061
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH96061%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for CH96061: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: VC90079
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC90079%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for VC90079: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: XR34915
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR34915%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for XR34915: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: VN57759
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN57759%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for VN57759: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: UF15161
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF15161%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for UF15161: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: XC12317
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: BD00645
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for SX16558: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: AT89899
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT89899%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for AT89899: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: SL14548
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL14548%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for SL14548: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: DG30240
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG30240%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for DG30240: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF64568%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for YF64568: 0
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: UL26956
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-28 10:50:11 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-28 10:50:11 [auto1.de] INFO: Scrape type for EA07160: 0
2026-03-28 10:50:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:44 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL11317%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for YL11317: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: JF45279
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF45279%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for JF45279: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51755%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for CU51755: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: RC77177
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: KM05428
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM05428%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for KM05428: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: TD03088
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: JW61268
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW61268%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for JW61268: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: KB01548
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: MY86649
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY86649%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for MY86649: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for RG61391: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: YZ28815
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ28815%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for YZ28815: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: HU07313
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU07313%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for HU07313: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: HN89991
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: MJ05239
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ05239%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for MJ05239: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX95177%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for XX95177: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: FD71544
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: FJ72421
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: LE12587
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: EG37222
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG37222%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for EG37222: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG15498%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for LG15498: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: TL57176
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL57176%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for TL57176: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: HU45030
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU45030%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for HU45030: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: FM34812
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: CU73818
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: YB47144
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: WG55926
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: HT53845
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT53845%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for HT53845: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: MF98327
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: TR03247
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: CU78638
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU78638%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for CU78638: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for TS65125: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-28 10:50:44 [auto1.de] INFO: Scrape type for EU98670: 0
2026-03-28 10:50:44 [auto1.de] INFO: Found listing with ID: ED90812
2026-03-28 10:50:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:45 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: DE00247
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC85459%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for AC85459: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for YS77012: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for ZW18782: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB10875%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for DB10875: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: SW52819
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: WK09344
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: PK14357
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK14357%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for PK14357: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for WK26503: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: EJ26253
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: BZ18787
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ18787%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for BZ18787: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC48761%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for RC48761: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: GP42203
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP42203%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for GP42203: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: NJ15905
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: GG24255
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG24255%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for GG24255: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: GV82392
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV82392%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for GV82392: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: MY91371
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY91371%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for MY91371: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for DL82245: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: BM91170
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM91170%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for BM91170: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: KH11075
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: PW43450
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: AA38462
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38462%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for AA38462: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: TZ59540
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ59540%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for TZ59540: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: UA38092
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: SP61181
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP61181%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for SP61181: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: NG71684
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG71684%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for NG71684: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: LX58961
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: CA26393
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26393%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for CA26393: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG41026%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for TG41026: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: NZ09394
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU02977%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for RU02977: 0
2026-03-28 10:50:45 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW98982%27 HTTP/1.1" 200 None
2026-03-28 10:50:45 [auto1.de] INFO: Scrape type for UW98982: 0
2026-03-28 10:50:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:50:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:50:53 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 9673 | hits on page: 40
2026-03-28 10:50:53 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-28 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-28 10:50:53 [auto1.de] INFO: Scrape type for YL01247: 0
2026-03-28 10:50:53 [auto1.de] INFO: Found listing with ID: RZ83508
2026-03-28 10:50:53 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-28 10:50:53 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for ZW60338: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: ZL58365
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL58365%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for ZL58365: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75303%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for LS75303: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: CH57776
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH57776%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for CH57776: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: SE89354
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE89354%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for SE89354: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: FH51774
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH51774%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for FH51774: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: DF27266
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for XH15947: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: ZZ35874
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ35874%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for ZZ35874: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: TK74975
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK74975%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for TK74975: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for LA13205: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: VH79690
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: DM73323
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE48308%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for ZE48308: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: LZ19661
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: ZA98026
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: TJ01230
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: CE41474
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41474%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for CE41474: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for UA25868: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: DD25870
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD25870%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for DD25870: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for ZJ06184: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: LF82683
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: TA27217
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA27217%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for TA27217: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: AR87733
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87733%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for AR87733: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: YC79153
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: FW46825
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: VA68941
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA68941%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for VA68941: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: DN95746
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN95746%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for DN95746: 0
2026-03-28 10:50:54 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX07003%27 HTTP/1.1" 200 None
2026-03-28 10:50:54 [auto1.de] INFO: Scrape type for GX07003: 0
2026-03-28 10:50:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:51:06 [scrapy.extensions.logstats] INFO: Crawled 346 pages (at 5 pages/min), scraped 219 items (at 0 items/min)
2026-03-28 10:51:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:51:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:51:15 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 9675 | hits on page: 40
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: DN95746
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN95746%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for DN95746: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX07003%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for GX07003: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: VS28124
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS28124%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for VS28124: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for PF14640: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: GL70534
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL70534%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for GL70534: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: CH21169
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: KA16702
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: UU48969
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU48969%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for UU48969: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY37084%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for BY37084: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: BS54687
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for ST87748: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV32169%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for SV32169: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: EP28641
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: UU77813
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU77813%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for UU77813: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: RB36890
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: FX70988
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for MG81975: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: RT58189
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT58189%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for RT58189: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: MD90322
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM54862%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for UM54862: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: HD53184
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD53184%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for HD53184: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR92554%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for ZR92554: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: UZ83781
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS44353%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for ZS44353: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: ZY59187
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY59187%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for ZY59187: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: SY82090
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: UA55919
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV16338%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for TV16338: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: UU45926
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for HA14963: 0
2026-03-28 10:51:15 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX33214%27 HTTP/1.1" 200 None
2026-03-28 10:51:15 [auto1.de] INFO: Scrape type for TX33214: 0
2026-03-28 10:51:16 [auto1.de] INFO: Found listing with ID: HL68502
2026-03-28 10:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL68502%27 HTTP/1.1" 200 None
2026-03-28 10:51:16 [auto1.de] INFO: Scrape type for HL68502: 0
2026-03-28 10:51:16 [auto1.de] INFO: Found listing with ID: FS10993
2026-03-28 10:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS10993%27 HTTP/1.1" 200 None
2026-03-28 10:51:16 [auto1.de] INFO: Scrape type for FS10993: 0
2026-03-28 10:51:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:51:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:51:22 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 9675 | hits on page: 40
2026-03-28 10:51:22 [auto1.de] INFO: Found listing with ID: DY94514
2026-03-28 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY94514%27 HTTP/1.1" 200 None
2026-03-28 10:51:22 [auto1.de] INFO: Scrape type for DY94514: 0
2026-03-28 10:51:22 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-28 10:51:22 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-28 10:51:22 [auto1.de] INFO: Found listing with ID: VU63720
2026-03-28 10:51:22 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-28 10:51:22 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-28 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN88809%27 HTTP/1.1" 200 None
2026-03-28 10:51:22 [auto1.de] INFO: Scrape type for HN88809: 0
2026-03-28 10:51:22 [auto1.de] INFO: Found listing with ID: UM42416
2026-03-28 10:51:22 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-28 10:51:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX80950%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for TX80950: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: XR09135
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: BK51387
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK51387%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for BK51387: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: HV36396
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: MR55647
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: ET88076
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET88076%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for ET88076: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: JJ41566
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD93379%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for AD93379: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: HC23327
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: ZF79989
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: MY79031
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79031%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for MY79031: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD70369%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for GD70369: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for VM82441: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: LL58658
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: LF42462
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF42462%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for LF42462: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for BP69696: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP94156%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for SP94156: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: DD19418
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: YC90372
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: TF24039
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF24039%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for TF24039: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: HH04688
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04688%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for HH04688: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: JV58210
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV58210%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for JV58210: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: AK28209
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK28209%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for AK28209: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: SL68511
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL68511%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for SL68511: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: PM76396
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM76396%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for PM76396: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: PN06461
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN06461%27 HTTP/1.1" 200 None
2026-03-28 10:51:23 [auto1.de] INFO: Scrape type for PN06461: 0
2026-03-28 10:51:23 [auto1.de] INFO: Found listing with ID: KR96778
2026-03-28 10:51:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:51:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:51:24 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 9675 | hits on page: 40
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77542%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for JZ77542: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: YR27652
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: WP16305
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP16305%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for WP16305: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: KW34660
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW34660%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for KW34660: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC21551%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for KC21551: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: XN24576
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN24576%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for XN24576: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: GJ45514
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: GE52020
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for CM78973: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for MV77064: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for EM22494: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: NZ42181
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for YJ21750: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: ED62579
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: XE48983
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE48983%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for XE48983: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: AT80326
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT80326%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for AT80326: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: PY74539
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY74539%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for PY74539: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: NR20309
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR20309%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for NR20309: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: NS28302
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for MN42254: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: JU00246
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: VB81192
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB81192%27 HTTP/1.1" 200 None
2026-03-28 10:51:24 [auto1.de] INFO: Scrape type for VB81192: 0
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: WN39089
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: DC41283
2026-03-28 10:51:24 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-28 10:51:25 [auto1.de] INFO: Scrape type for PJ34146: 0
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: AM54247
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM54247%27 HTTP/1.1" 200 None
2026-03-28 10:51:25 [auto1.de] INFO: Scrape type for AM54247: 0
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: DT97256
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: BE84221
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE84221%27 HTTP/1.1" 200 None
2026-03-28 10:51:25 [auto1.de] INFO: Scrape type for BE84221: 0
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-28 10:51:25 [auto1.de] INFO: Scrape type for PC67993: 0
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: YR83365
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR83365%27 HTTP/1.1" 200 None
2026-03-28 10:51:25 [auto1.de] INFO: Scrape type for YR83365: 0
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: WR86078
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR86078%27 HTTP/1.1" 200 None
2026-03-28 10:51:25 [auto1.de] INFO: Scrape type for WR86078: 0
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: AM86665
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM86665%27 HTTP/1.1" 200 None
2026-03-28 10:51:25 [auto1.de] INFO: Scrape type for AM86665: 0
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-28 10:51:25 [auto1.de] INFO: Scrape type for KL68094: 0
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-28 10:51:25 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:51:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-28 10:51:25 [auto1.de] INFO: Scrape type for CC57472: 0
2026-03-28 10:51:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:52:06 [scrapy.extensions.logstats] INFO: Crawled 349 pages (at 3 pages/min), scraped 219 items (at 0 items/min)
2026-03-28 10:52:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:52:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:52:35 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 9674 | hits on page: 40
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: NL78703
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: VB40979
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: FT42679
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT42679%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for FT42679: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: VJ42576
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for ZA60248: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: JR79964
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR79964%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for JR79964: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: KP25975
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: VF94022
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: ZX49680
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ76482%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for HJ76482: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for BJ31953: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: AT96377
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: TW53975
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: KB02253
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB02253%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for KB02253: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: ZJ32938
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ32938%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for ZJ32938: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED78349%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for ED78349: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: AY57867
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57867%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for AY57867: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: KC97074
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for AR60138: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: VR22354
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR22354%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for VR22354: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: BS18146
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS18146%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for BS18146: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for GR91976: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC32133%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for HC32133: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: TG31378
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG31378%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for TG31378: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for RZ07739: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ91538%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for UJ91538: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: CJ76479
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ76479%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for CJ76479: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: LS64729
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD99689%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for LD99689: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: MD90588
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: AM47458
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM47458%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for AM47458: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP93832%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for AP93832: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: WF14643
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF14643%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for WF14643: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: FE81350
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE81350%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for FE81350: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: EC31076
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC31076%27 HTTP/1.1" 200 None
2026-03-28 10:52:35 [auto1.de] INFO: Scrape type for EC31076: 0
2026-03-28 10:52:35 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-28 10:52:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:52:38 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 9674 | hits on page: 40
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: KL04932
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: ZF28173
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28173%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for ZF28173: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: DX07392
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX07392%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for DX07392: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: JZ39033
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ39033%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for JZ39033: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE82588%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for AE82588: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: VS55791
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: TC16779
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC16779%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for TC16779: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH05952%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for NH05952: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: PL22285
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL22285%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for PL22285: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: SW58559
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: AD50252
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: LY07442
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: ZC99377
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC99377%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for ZC99377: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: ZH98765
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH98765%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for ZH98765: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for HM36828: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: UJ86189
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ86189%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for UJ86189: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: KX31285
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for YH32466: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: TM05155
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM05155%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for TM05155: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for SH34786: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: GD63015
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: PD23584
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: SN07258
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN07258%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for SN07258: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: PE56791
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE56791%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for PE56791: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: BU73961
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: FP09616
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for ZY67116: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: JA70507
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: UJ61618
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ61618%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for UJ61618: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: CZ79831
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ79831%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for CZ79831: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for NP30819: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: EG42583
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: SA11397
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11397%27 HTTP/1.1" 200 None
2026-03-28 10:52:38 [auto1.de] INFO: Scrape type for SA11397: 0
2026-03-28 10:52:38 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-28 10:52:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:52:40 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 9674 | hits on page: 40
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: UY48646
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY48646%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for UY48646: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ58710%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for LZ58710: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63466%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for VY63466: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: SC28168
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for UP16968: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: JZ87403
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ87403%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for JZ87403: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83133%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for KX83133: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: LR63660
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: MV80796
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN24423%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for GN24423: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV55966%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for FV55966: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: SY31526
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY31526%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for SY31526: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: ZJ94268
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: PZ85127
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: MF84483
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF84483%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for MF84483: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: FV82403
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ33260%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for RZ33260: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: GF09833
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09833%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for GF09833: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: JN43536
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN43536%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for JN43536: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: WK72065
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK72065%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for WK72065: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: HX62286
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: MF28588
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF28588%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for MF28588: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: MR37320
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37320%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for MR37320: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: AD85372
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: JS52679
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: PL74690
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL74690%27 HTTP/1.1" 200 None
2026-03-28 10:52:40 [auto1.de] INFO: Scrape type for PL74690: 0
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: TA17370
2026-03-28 10:52:40 [auto1.de] INFO: Found listing with ID: GD45566
2026-03-28 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD45566%27 HTTP/1.1" 200 None
2026-03-28 10:52:41 [auto1.de] INFO: Scrape type for GD45566: 0
2026-03-28 10:52:41 [auto1.de] INFO: Found listing with ID: WA28068
2026-03-28 10:52:41 [auto1.de] INFO: Found listing with ID: WJ71939
2026-03-28 10:52:41 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-28 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-28 10:52:41 [auto1.de] INFO: Scrape type for ZW96632: 0
2026-03-28 10:52:41 [auto1.de] INFO: Found listing with ID: UK33964
2026-03-28 10:52:41 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-28 10:52:41 [auto1.de] INFO: Found listing with ID: AN22906
2026-03-28 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN22906%27 HTTP/1.1" 200 None
2026-03-28 10:52:41 [auto1.de] INFO: Scrape type for AN22906: 0
2026-03-28 10:52:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:52:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:52:42 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 9674 | hits on page: 40
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: ZY13733
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13733%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for ZY13733: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for PA77354: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: YM61958
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: RB12464
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB12464%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for RB12464: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: BX80092
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX80092%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for BX80092: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: AP30788
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP30788%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for AP30788: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: DX36556
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: CV85999
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD16750%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for AD16750: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN60852%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for KN60852: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: VB96858
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96858%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for VB96858: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: UH63993
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH63993%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for UH63993: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85080%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for XY85080: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: SZ20941
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: AW32080
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW32080%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for AW32080: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: FT09783
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for PP42616: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: WB92909
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP99262%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for RP99262: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: FH63073
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: RY11817
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for LZ76677: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for YJ21289: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: MA95783
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: KZ31354
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ31354%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for KZ31354: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: EW67341
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW17934%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for GW17934: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: AC08857
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC28332%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for JC28332: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: KR13539
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR13539%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for KR13539: 0
2026-03-28 10:52:42 [auto1.de] INFO: Found listing with ID: WJ75594
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ75594%27 HTTP/1.1" 200 None
2026-03-28 10:52:42 [auto1.de] INFO: Scrape type for WJ75594: 0
2026-03-28 10:52:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:52:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:52:54 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 9674 | hits on page: 40
2026-03-28 10:52:54 [auto1.de] INFO: Found listing with ID: TY90085
2026-03-28 10:52:54 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-28 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-28 10:52:54 [auto1.de] INFO: Scrape type for SM94434: 0
2026-03-28 10:52:54 [auto1.de] INFO: Found listing with ID: AJ01843
2026-03-28 10:52:54 [auto1.de] INFO: Found listing with ID: PY95410
2026-03-28 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY95410%27 HTTP/1.1" 200 None
2026-03-28 10:52:54 [auto1.de] INFO: Scrape type for PY95410: 0
2026-03-28 10:52:54 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-28 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-28 10:52:54 [auto1.de] INFO: Scrape type for PY88253: 0
2026-03-28 10:52:54 [auto1.de] INFO: Found listing with ID: RT92200
2026-03-28 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT92200%27 HTTP/1.1" 200 None
2026-03-28 10:52:54 [auto1.de] INFO: Scrape type for RT92200: 0
2026-03-28 10:52:54 [auto1.de] INFO: Found listing with ID: XF50561
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF50561%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for XF50561: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: HU45094
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: PR75210
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: UP37190
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: YR65508
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: RT09280
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB32004%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for WB32004: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: BM72646
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM72646%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for BM72646: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: JW05714
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: JE98088
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for LN53329: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: UC69607
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC69607%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for UC69607: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16745%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for WF16745: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16103%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for YT16103: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34556%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for JN34556: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: BC71264
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: DB54386
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: DE70516
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: AN12831
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN12831%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for AN12831: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: EL83398
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: XE96364
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE96364%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for XE96364: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: FG57535
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG57535%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for FG57535: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: GN29704
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN29704%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for GN29704: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: WH80890
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH80890%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for WH80890: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for DP55195: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for KZ71348: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: ZW43695
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW43695%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for ZW43695: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: TK89986
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY62455%27 HTTP/1.1" 200 None
2026-03-28 10:52:55 [auto1.de] INFO: Scrape type for DY62455: 0
2026-03-28 10:52:55 [auto1.de] INFO: Found listing with ID: CS42122
2026-03-28 10:52:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:52:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:52:59 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 9674 | hits on page: 40
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: VU26038
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-28 10:52:59 [auto1.de] INFO: Scrape type for ZC46474: 0
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-28 10:52:59 [auto1.de] INFO: Scrape type for FH83727: 0
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-28 10:52:59 [auto1.de] INFO: Scrape type for XR30933: 0
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: FZ97744
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: FU42762
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU42762%27 HTTP/1.1" 200 None
2026-03-28 10:52:59 [auto1.de] INFO: Scrape type for FU42762: 0
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: NV55491
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55491%27 HTTP/1.1" 200 None
2026-03-28 10:52:59 [auto1.de] INFO: Scrape type for NV55491: 0
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: YF52750
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF52750%27 HTTP/1.1" 200 None
2026-03-28 10:52:59 [auto1.de] INFO: Scrape type for YF52750: 0
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: HX03519
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX03519%27 HTTP/1.1" 200 None
2026-03-28 10:52:59 [auto1.de] INFO: Scrape type for HX03519: 0
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: UZ16181
2026-03-28 10:52:59 [auto1.de] INFO: Found listing with ID: MS62719
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS62719%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for MS62719: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for TB37654: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: SR67538
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: JR27484
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR27484%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for JR27484: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: EX94695
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX94695%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for EX94695: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: PN20097
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN20097%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for PN20097: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: UA31862
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: FP87912
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: JF93037
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: LY36770
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY36770%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for LY36770: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: KS41685
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41685%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for KS41685: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for HA91024: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: ZZ69098
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36111%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for EC36111: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: DR00758
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: XK53444
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK53444%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for XK53444: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: ZK88504
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: UB87978
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB87978%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for UB87978: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: DU95569
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: WC00237
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC00237%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for WC00237: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: JE86051
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: YL83790
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for YF79248: 0
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: TA53494
2026-03-28 10:53:00 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-28 10:53:00 [auto1.de] INFO: Scrape type for MC25913: 0
2026-03-28 10:53:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:53:06 [scrapy.extensions.logstats] INFO: Crawled 355 pages (at 6 pages/min), scraped 219 items (at 0 items/min)
2026-03-28 10:53:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:54:06 [scrapy.extensions.logstats] INFO: Crawled 355 pages (at 0 pages/min), scraped 219 items (at 0 items/min)
2026-03-28 10:54:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:54:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:14 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 9676 | hits on page: 40
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: TA53494
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for MC25913: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: NP13175
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: KS63717
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: FT98608
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT98608%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for FT98608: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: GA14949
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: JG20363
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: NU10771
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU10771%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for NU10771: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: XL21584
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: DX08468
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX08468%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for DX08468: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: XK58974
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK58974%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for XK58974: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: BV38290
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38290%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for BV38290: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for XV42513: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: DP39358
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP39358%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for DP39358: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: TJ48727
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: US71241
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: RT49576
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49576%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for RT49576: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: LH00123
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for KT21278: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: GX30612
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX30612%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for GX30612: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: WV66360
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV66360%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for WV66360: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: DK15420
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP20518%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for HP20518: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND74491%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for ND74491: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for ZM65960: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: WW30672
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: BM70881
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: VH10251
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: YV13376
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV13376%27 HTTP/1.1" 200 None
2026-03-28 10:54:14 [auto1.de] INFO: Scrape type for YV13376: 0
2026-03-28 10:54:14 [auto1.de] INFO: Found listing with ID: NR78945
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR78945%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for NR78945: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: NC53020
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: TF56080
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF56080%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for TF56080: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: CB60323
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for DB69488: 0
2026-03-28 10:54:15 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL04690%27 HTTP/1.1" 200 None
2026-03-28 10:54:15 [auto1.de] INFO: Scrape type for CL04690: 0
2026-03-28 10:54:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:16 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 9676 | hits on page: 40
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: FY34771
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for YF83541: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: AW34840
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: AP83246
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for EB43981: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for AM22108: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: YF37634
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF37634%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for YF37634: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: YZ97143
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: XE27570
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ67143%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for VZ67143: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY29315%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for PY29315: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: WV18755
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: FT81619
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: HX10510
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX10510%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for HX10510: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: RA28898
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for BW09320: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: DN55210
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN55210%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for DN55210: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: CJ14653
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: WY54467
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54467%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for WY54467: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: EF17850
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF17850%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for EF17850: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK91002%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for YK91002: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG62319%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for EG62319: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: NZ55073
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: GU28409
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: UU71497
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU71497%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for UU71497: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: ZX84028
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: DH94169
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: KF03787
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF03787%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for KF03787: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: HB59808
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB59808%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for HB59808: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: GP04602
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for AT78165: 0
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: DR78688
2026-03-28 10:54:16 [auto1.de] INFO: Found listing with ID: ML80867
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML80867%27 HTTP/1.1" 200 None
2026-03-28 10:54:16 [auto1.de] INFO: Scrape type for ML80867: 0
2026-03-28 10:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:17 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 9676 | hits on page: 40
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: BY66745
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: ZD20982
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD20982%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for ZD20982: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: GP35635
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP35635%27 HTTP/1.1" 200 None
2026-03-28 10:54:17 [auto1.de] INFO: Scrape type for GP35635: 0
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: VE74198
2026-03-28 10:54:17 [auto1.de] INFO: Found listing with ID: VD76950
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD76950%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for VD76950: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88741%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for PH88741: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: RF82570
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: CT48596
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: XC02401
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: PR60744
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR60744%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for PR60744: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: CT34743
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT34743%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for CT34743: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47602%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for RX47602: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL35659%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for SL35659: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: VV12952
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for PU11267: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for UA25928: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: GU38218
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU38218%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for GU38218: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: KX72487
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX72487%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for KX72487: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: LS15583
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: XV84732
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV84732%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for XV84732: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for EP31898: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: VR43125
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for BK73701: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for CF53394: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: SC92395
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: HE94758
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE94758%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for HE94758: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: HD83782
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83782%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for HD83782: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: MS15340
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS15340%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for MS15340: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL54594%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for DL54594: 0
2026-03-28 10:54:18 [auto1.de] INFO: Found listing with ID: SJ07380
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ07380%27 HTTP/1.1" 200 None
2026-03-28 10:54:18 [auto1.de] INFO: Scrape type for SJ07380: 0
2026-03-28 10:54:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:37 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 9678 | hits on page: 40
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL54594%27 HTTP/1.1" 200 None
2026-03-28 10:54:37 [auto1.de] INFO: Scrape type for DL54594: 0
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: SJ07380
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ07380%27 HTTP/1.1" 200 None
2026-03-28 10:54:37 [auto1.de] INFO: Scrape type for SJ07380: 0
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: NH90612
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH90612%27 HTTP/1.1" 200 None
2026-03-28 10:54:37 [auto1.de] INFO: Scrape type for NH90612: 0
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ63004%27 HTTP/1.1" 200 None
2026-03-28 10:54:37 [auto1.de] INFO: Scrape type for LZ63004: 0
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: VN15291
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN15291%27 HTTP/1.1" 200 None
2026-03-28 10:54:37 [auto1.de] INFO: Scrape type for VN15291: 0
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-28 10:54:37 [auto1.de] INFO: Scrape type for TA95211: 0
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: JH32543
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: FX11245
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX11245%27 HTTP/1.1" 200 None
2026-03-28 10:54:37 [auto1.de] INFO: Scrape type for FX11245: 0
2026-03-28 10:54:37 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-28 10:54:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK20296%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for EK20296: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for TN24608: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: NA05551
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: VJ91223
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ91223%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for VJ91223: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: NP76557
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP76557%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for NP76557: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: BU33854
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU33854%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for BU33854: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG02873%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for MG02873: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: XA58573
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: JR91951
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR91951%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for JR91951: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: DM83543
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM83543%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for DM83543: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: AL68838
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: AF55213
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: SL88176
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL88176%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for SL88176: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for NX47984: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: AM90654
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM90654%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for AM90654: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for AE81199: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: XA78750
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: DC32066
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for NS17757: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for RU51432: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX61710%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for NX61710: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: LL60236
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: CW00084
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW00084%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for CW00084: 0
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: JC86986
2026-03-28 10:54:38 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW76497%27 HTTP/1.1" 200 None
2026-03-28 10:54:38 [auto1.de] INFO: Scrape type for DW76497: 0
2026-03-28 10:54:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:49 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 9679 | hits on page: 40
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW76497%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for DW76497: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: BB99757
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for NW88180: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: TD86732
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD86732%27 HTTP/1.1" 200 None
2026-03-28 10:54:49 [auto1.de] INFO: Scrape type for TD86732: 0
2026-03-28 10:54:49 [auto1.de] INFO: Found listing with ID: CY30248
2026-03-28 10:54:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY30248%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for CY30248: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY40414%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for JY40414: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: BW18198
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18198%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for BW18198: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: TZ47982
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: RZ82466
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ82466%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for RZ82466: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: SJ24740
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ24740%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for SJ24740: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: UZ74355
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: NS26780
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS26780%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for NS26780: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for PS90319: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: LB67403
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB67403%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for LB67403: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: JF05808
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF05808%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for JF05808: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: TK16226
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: TT57890
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: DJ51254
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ51254%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for DJ51254: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: MC69974
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC69974%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for MC69974: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for SW40365: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for AH38821: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: TP89237
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: MN03229
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: LX44936
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for GG65874: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for JS58048: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH98147%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for TH98147: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: GB84856
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: SN71189
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN71189%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for SN71189: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: SG03941
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for HB57575: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: UC97220
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC97220%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for UC97220: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: RG09784
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG09784%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for RG09784: 0
2026-03-28 10:54:50 [auto1.de] INFO: Found listing with ID: HR87119
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR87119%27 HTTP/1.1" 200 None
2026-03-28 10:54:50 [auto1.de] INFO: Scrape type for HR87119: 0
2026-03-28 10:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:54:55 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 9680 | hits on page: 40
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: HR87119
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR87119%27 HTTP/1.1" 200 None
2026-03-28 10:54:55 [auto1.de] INFO: Scrape type for HR87119: 0
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: XH73530
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH73530%27 HTTP/1.1" 200 None
2026-03-28 10:54:55 [auto1.de] INFO: Scrape type for XH73530: 0
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: SS53525
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS53525%27 HTTP/1.1" 200 None
2026-03-28 10:54:55 [auto1.de] INFO: Scrape type for SS53525: 0
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: CA90460
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: SM57605
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM57605%27 HTTP/1.1" 200 None
2026-03-28 10:54:55 [auto1.de] INFO: Scrape type for SM57605: 0
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: TD37503
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD37503%27 HTTP/1.1" 200 None
2026-03-28 10:54:55 [auto1.de] INFO: Scrape type for TD37503: 0
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: HG98995
2026-03-28 10:54:55 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ79239%27 HTTP/1.1" 200 None
2026-03-28 10:54:55 [auto1.de] INFO: Scrape type for WJ79239: 2
2026-03-28 10:54:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with identifier: WJ79239
2026-03-28 10:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with scrape type 2
2026-03-28 10:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with scrape type 2
2026-03-28 10:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1, identifier: WJ79239
2026-03-28 10:54:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with identifier: WJ79239
2026-03-28 10:54:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with identifier: WJ79239
2026-03-28 10:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1 with identifier: WJ79239 to the API
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:02:00Z',
 'fuel_type': 'petrol',
 'id': 'c2cf26f8-a27e-5171-8dc8-1fb7107cc3f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ79239',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Exeo',
 'odometer': 190557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Seat Exeo 1.8 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2010}
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ79239%27 HTTP/1.1" 200 None
2026-03-28 10:54:56 [auto1.de] INFO: Saving data for WJ79239: {'auction_closing_time': 1774713720.0, 'created_time': 1773345548.901725, 'last_price_update_time': 1774695296.398382}
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ79239') HTTP/1.1" 204 0
2026-03-28 10:54:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: KJ03468
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: MU84465
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: KE21243
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: XE92284
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: PF58362
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF58362%27 HTTP/1.1" 200 None
2026-03-28 10:54:56 [auto1.de] INFO: Scrape type for PF58362: 0
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB75427%27 HTTP/1.1" 200 None
2026-03-28 10:54:56 [auto1.de] INFO: Scrape type for RB75427: 0
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: FP76124
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP76124%27 HTTP/1.1" 200 None
2026-03-28 10:54:56 [auto1.de] INFO: Scrape type for FP76124: 0
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-28 10:54:56 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-28 10:54:56 [auto1.de] INFO: Scrape type for RA95780: 2
2026-03-28 10:54:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d12e87e-8614-59fd-8dab-0a44a48b0530 with identifier: RA95780
2026-03-28 10:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d12e87e-8614-59fd-8dab-0a44a48b0530 with scrape type 2
2026-03-28 10:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d12e87e-8614-59fd-8dab-0a44a48b0530 with scrape type 2
2026-03-28 10:54:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d12e87e-8614-59fd-8dab-0a44a48b0530, identifier: RA95780
2026-03-28 10:54:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d12e87e-8614-59fd-8dab-0a44a48b0530 with identifier: RA95780
2026-03-28 10:54:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d12e87e-8614-59fd-8dab-0a44a48b0530 with identifier: RA95780
2026-03-28 10:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d12e87e-8614-59fd-8dab-0a44a48b0530 with identifier: RA95780 to the API
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 10:54:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 10:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 557,
 'expiration_date': '2026-03-28T16:03:56Z',
 'fuel_type': 'petrol',
 'id': '0d12e87e-8614-59fd-8dab-0a44a48b0530',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA95780',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GL-Klasse',
 'odometer': 168594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GL-Klasse GL 63 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2014}
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Saving data for RA95780: {'auction_closing_time': 1774713836.0, 'created_time': 1774510548.318218, 'last_price_update_time': 1774695297.073105}
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA95780') HTTP/1.1" 204 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for EN92666: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: MD04990
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD04990%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for MD04990: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: NH29659
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH29659%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for NH29659: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: FW12178
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: XY98739
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF03838%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for YF03838: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: CK05183
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK05183%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for CK05183: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: VY08054
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: HN30434
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30434%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for HN30434: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: ZJ77076
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: BC91318
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67465%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for CL67465: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: SL22871
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL22871%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for SL22871: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for NR35132: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: LE21028
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21028%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for LE21028: 0
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-28 10:54:57 [auto1.de] INFO: Found listing with ID: EN28184
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:54:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN28184%27 HTTP/1.1" 200 None
2026-03-28 10:54:57 [auto1.de] INFO: Scrape type for EN28184: 0
2026-03-28 10:55:06 [scrapy.extensions.logstats] INFO: Crawled 361 pages (at 6 pages/min), scraped 221 items (at 2 items/min)
2026-03-28 10:55:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:55:29 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 9680 | hits on page: 40
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: MN16875
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN16875%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for MN16875: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: FJ59551
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59551%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for FJ59551: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: AV05824
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: JS88024
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS88024%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for JS88024: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM05984%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for WM05984: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB93098%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for WB93098: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: EM02762
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM02762%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for EM02762: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: DW83875
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW83875%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for DW83875: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75444%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for NK75444: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: AW09082
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS89586%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for AS89586: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: DR39868
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR39868%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for DR39868: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: XE25364
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE25364%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for XE25364: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW17566%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for FW17566: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV75755%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for BV75755: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: BZ38132
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: MS67851
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN63665%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for MN63665: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: JY42391
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: RB92475
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB92475%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for RB92475: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: FZ45085
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: YE52514
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: AK40510
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ04557%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for CJ04557: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: KM46516
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19683%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for NL19683: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE98096%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for RE98096: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC37981%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for WC37981: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: PM59484
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM59484%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for PM59484: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: YA43957
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK76188%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for RK76188: 0
2026-03-28 10:55:29 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN12200%27 HTTP/1.1" 200 None
2026-03-28 10:55:29 [auto1.de] INFO: Scrape type for VN12200: 0
2026-03-28 10:55:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:55:38 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 9681 | hits on page: 40
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN12200%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for VN12200: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: AC23396
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC23396%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for AC23396: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD27058%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for UD27058: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: BV95074
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV95074%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for BV95074: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: DY63135
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: TH48846
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: NE41084
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE41084%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for NE41084: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR97164%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for MR97164: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF08399%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for LF08399: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM35820%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for PM35820: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: RU55030
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU55030%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for RU55030: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: WW62013
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW62013%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for WW62013: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: WR30100
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR30100%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for WR30100: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: XV83680
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: YH32821
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32821%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for YH32821: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE66446%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for EE66446: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: AG95763
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: HB95845
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95845%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for HB95845: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA20211%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for SA20211: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS47149%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for BS47149: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE48673%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for UE48673: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC02620%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for DC02620: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU38066%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for XU38066: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: WT35488
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: DV40651
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40651%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for DV40651: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: RT81872
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: VF65957
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF65957%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for VF65957: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: NH24337
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH24337%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for NH24337: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: AP35212
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP35212%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for AP35212: 0
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-28 10:55:38 [auto1.de] INFO: Found listing with ID: FS21817
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS21817%27 HTTP/1.1" 200 None
2026-03-28 10:55:38 [auto1.de] INFO: Scrape type for FS21817: 0
2026-03-28 10:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:55:39 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 9681 | hits on page: 40
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: NV29548
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV29548%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for NV29548: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: YC36661
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: FB28212
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: XV50730
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50730%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for XV50730: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: AB51918
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: WB14215
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB14215%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for WB14215: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: WX47681
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX47681%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for WX47681: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: FN84254
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: VL22817
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL22817%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for VL22817: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: VV56581
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: PH05678
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH05678%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for PH05678: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: ZR87762
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: CG13021
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG13021%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for CG13021: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: SW73326
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: FH57861
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH57861%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for FH57861: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: NR21385
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR21385%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for NR21385: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB34428%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for MB34428: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: UE28545
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28545%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for UE28545: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: DP38441
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: TE81781
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: EZ75910
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ75910%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for EZ75910: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: CT92868
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT92868%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for CT92868: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: WF64949
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: LX19893
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX19893%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for LX19893: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: ED90776
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC44114%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for RC44114: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: XB12574
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB12574%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for XB12574: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: GS10742
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF51547%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for ZF51547: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY44506%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for FY44506: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV36056%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for NV36056: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: SB19152
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: VU26933
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU26933%27 HTTP/1.1" 200 None
2026-03-28 10:55:39 [auto1.de] INFO: Scrape type for VU26933: 0
2026-03-28 10:55:39 [auto1.de] INFO: Found listing with ID: PV39631
2026-03-28 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV39631%27 HTTP/1.1" 200 None
2026-03-28 10:55:40 [auto1.de] INFO: Scrape type for PV39631: 0
2026-03-28 10:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:55:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:55:52 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 9681 | hits on page: 40
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: BE79693
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE79693%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for BE79693: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: EL88156
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: UV51707
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR97756%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for NR97756: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: WJ30276
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN86054%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for TN86054: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: HS07572
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS14457%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for XS14457: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: FG49990
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG49990%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for FG49990: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: EW66655
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: PG72252
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB23649%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for EB23649: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: MA26612
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA26612%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for MA26612: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: ST40572
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82276%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for LL82276: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB55573%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for BB55573: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: JU35192
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU35192%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for JU35192: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for BB56040: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ03157%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for FZ03157: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX23620%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for NX23620: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR50974%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for YR50974: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW78119%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for VW78119: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX36135%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for BX36135: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: EL52738
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL52738%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for EL52738: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW97614%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for NW97614: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH89792%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for JH89792: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71563%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for KZ71563: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP99988%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for GP99988: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN58244%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for JN58244: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH08686%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for GH08686: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW09087%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for SW09087: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ75608%27 HTTP/1.1" 200 None
2026-03-28 10:55:52 [auto1.de] INFO: Scrape type for ZZ75608: 0
2026-03-28 10:55:52 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-28 10:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:55:55 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 9681 | hits on page: 40
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: ZH33487
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR33136%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for CR33136: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64393%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for LK64393: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK60330%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for RK60330: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: NZ73974
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ73974%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for NZ73974: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41620%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for MJ41620: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: CG19122
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE33973%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for HE33973: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC06699%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for BC06699: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: TU49372
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: US66505
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66505%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for US66505: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05119%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for YT05119: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: TZ79275
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB29022%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for MB29022: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: LW88840
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG03972%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for BG03972: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK46360%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for CK46360: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET31330%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for ET31330: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64599%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for PN64599: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK39735%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for YK39735: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG82631%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for ZG82631: 0
2026-03-28 10:55:55 [auto1.de] INFO: Found listing with ID: TL33635
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL33635%27 HTTP/1.1" 200 None
2026-03-28 10:55:55 [auto1.de] INFO: Scrape type for TL33635: 0
2026-03-28 10:55:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:55:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:55:57 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 9681 | hits on page: 40
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE30080%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for RE30080: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL90320%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for CL90320: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP02134%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for FP02134: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: SX18617
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18617%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for SX18617: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: ZS32516
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ93598%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for HZ93598: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: FP85945
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP85945%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for FP85945: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: KZ93271
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ93271%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for KZ93271: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: EL64593
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL64593%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for EL64593: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: MJ27519
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ27519%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for MJ27519: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: FV38538
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV38538%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for FV38538: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV15803%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for WV15803: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: FJ25741
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ25741%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for FJ25741: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV47802%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for VV47802: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48264%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for JP48264: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME33936%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for ME33936: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: AX65936
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX65936%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for AX65936: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13980%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for EP13980: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV90463%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for LV90463: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD30774%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for ZD30774: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR25220%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for BR25220: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: US43373
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US43373%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for US43373: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: GZ32415
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: JW43504
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW43504%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for JW43504: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: KX05072
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: ST70161
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST70161%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for ST70161: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: NG47626
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: RU88109
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL44466%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for YL44466: 0
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-28 10:55:57 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:55:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC43890%27 HTTP/1.1" 200 None
2026-03-28 10:55:57 [auto1.de] INFO: Scrape type for BC43890: 0
2026-03-28 10:55:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:05 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 9681 | hits on page: 40
2026-03-28 10:56:05 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-28 10:56:05 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-28 10:56:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB65040%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for VB65040: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: ES58004
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES58004%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for ES58004: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ12111%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for BZ12111: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX11356%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for LX11356: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD42848%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for XD42848: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: JA32150
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA32150%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for JA32150: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP11362%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for FP11362: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: XF72259
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF72259%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for XF72259: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV33102%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for HV33102: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: TE65215
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE65215%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for TE65215: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL91584%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for PL91584: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN61962%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for EN61962: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK62428%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for VK62428: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX54402%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for MX54402: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB52644%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for YB52644: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD63054%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for TD63054: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: JB48041
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: VK55236
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK55236%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for VK55236: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW87907%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for MW87907: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA74334%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for EA74334: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: YP75946
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP75946%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for YP75946: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: BE74196
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA58180%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for DA58180: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA63684%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for WA63684: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: MA19340
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN59974%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for DN59974: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS57096%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for KS57096: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG79588%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for FG79588: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM02183%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for YM02183: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: LA55679
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA55679%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for LA55679: 0
2026-03-28 10:56:06 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC89129%27 HTTP/1.1" 200 None
2026-03-28 10:56:06 [auto1.de] INFO: Scrape type for XC89129: 0
2026-03-28 10:56:06 [scrapy.extensions.logstats] INFO: Crawled 368 pages (at 7 pages/min), scraped 221 items (at 0 items/min)
2026-03-28 10:56:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:56:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:56:26 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 9682 | hits on page: 40
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC89129%27 HTTP/1.1" 200 None
2026-03-28 10:56:26 [auto1.de] INFO: Scrape type for XC89129: 0
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ49473%27 HTTP/1.1" 200 None
2026-03-28 10:56:26 [auto1.de] INFO: Scrape type for RZ49473: 0
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: PW59842
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91836%27 HTTP/1.1" 200 None
2026-03-28 10:56:26 [auto1.de] INFO: Scrape type for FY91836: 0
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT32036%27 HTTP/1.1" 200 None
2026-03-28 10:56:26 [auto1.de] INFO: Scrape type for UT32036: 0
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: TE19568
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE19568%27 HTTP/1.1" 200 None
2026-03-28 10:56:26 [auto1.de] INFO: Scrape type for TE19568: 0
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-28 10:56:26 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92203%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for WM92203: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: WZ27773
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: CG60505
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR96643%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for MR96643: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ05424%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for UZ05424: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ70582%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for BJ70582: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ09435%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for EZ09435: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: JH49592
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH49592%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for JH49592: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP76789%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for KP76789: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54290%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for BH54290: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: HJ47898
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: JM37060
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM37060%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for JM37060: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ63393%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for JZ63393: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: KB63529
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB63529%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for KB63529: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF58718%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for DF58718: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: KC83208
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC83208%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for KC83208: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: DF80401
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43424%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for HA43424: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: AK10230
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK10230%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for AK10230: 0
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: XF71877
2026-03-28 10:56:27 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:56:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA44966%27 HTTP/1.1" 200 None
2026-03-28 10:56:27 [auto1.de] INFO: Scrape type for RA44966: 0
2026-03-28 10:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:03 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 9683 | hits on page: 40
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA44966%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for RA44966: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: GE38296
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: TC10400
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: LW37841
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: UZ23032
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ23032%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for UZ23032: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: MU37788
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: ST46361
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: CV46070
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU54451%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for CU54451: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: GE13857
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE13857%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for GE13857: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YE54237
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: UC90003
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC90003%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for UC90003: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: PM00839
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM00839%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for PM00839: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG24433%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for YG24433: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: RA09675
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA09675%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for RA09675: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YN58840
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN58840%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for YN58840: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: SR24590
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR24590%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for SR24590: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: WP38302
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: LL32931
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL32931%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for LL32931: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: JR72370
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR72370%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for JR72370: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: LH42937
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: RK58200
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: NW48932
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW48932%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for NW48932: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: CU25460
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: LB53588
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB53588%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for LB53588: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF22062%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for AF22062: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: VU78681
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU78681%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for VU78681: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: NH66638
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YB76933
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: KB30822
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: UW51602
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW51602%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for UW51602: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: WB23557
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB23557%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for WB23557: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: PV88036
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: PT29728
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29728%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for PT29728: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: GR22729
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: CH93356
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93356%27 HTTP/1.1" 200 None
2026-03-28 10:57:03 [auto1.de] INFO: Scrape type for CH93356: 0
2026-03-28 10:57:03 [auto1.de] INFO: Found listing with ID: FV31347
2026-03-28 10:57:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV31347%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for FV31347: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: RL64280
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL64280%27 HTTP/1.1" 200 None
2026-03-28 10:57:04 [auto1.de] INFO: Scrape type for RL64280: 0
2026-03-28 10:57:04 [auto1.de] INFO: Found listing with ID: VS97979
2026-03-28 10:57:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:06 [scrapy.extensions.logstats] INFO: Crawled 370 pages (at 2 pages/min), scraped 221 items (at 0 items/min)
2026-03-28 10:57:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:08 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 9684 | hits on page: 40
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: VS97979
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP67523%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for AP67523: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: WJ27645
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU36809%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for EU36809: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75545%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for YR75545: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: YU45811
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU45811%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for YU45811: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: HJ23200
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ23200%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for HJ23200: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH86896%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for NH86896: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: LM35319
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM35319%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for LM35319: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38517%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for AA38517: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: ND92917
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND92917%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for ND92917: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: GC41711
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC41711%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for GC41711: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51107%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for SS51107: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: RT85975
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT85975%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for RT85975: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: CZ37102
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: UN55665
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN55665%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for UN55665: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: SX94415
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: ZH78553
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: GZ12434
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ12434%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for GZ12434: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: EF19771
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW04069%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for RW04069: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: NJ07405
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: TM10455
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: DM85685
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: EU26166
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: GS88086
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: UH92417
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV57552%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for XV57552: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: ZF36287
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: UY49029
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY49029%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for UY49029: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: PB03709
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB03709%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for PB03709: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: MT89119
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS23827%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for FS23827: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL23730%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for EL23730: 0
2026-03-28 10:57:08 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY40136%27 HTTP/1.1" 200 None
2026-03-28 10:57:08 [auto1.de] INFO: Scrape type for TY40136: 0
2026-03-28 10:57:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:10 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 9684 | hits on page: 40
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: LB55068
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: EV33886
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV33886%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for EV33886: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: DH53095
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH53095%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for DH53095: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM91896%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for TM91896: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: ES20702
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES20702%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for ES20702: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: BR66744
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: SY93073
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY93073%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for SY93073: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: XE28025
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE28025%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for XE28025: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: LB14503
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: DF28999
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56526%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for KU56526: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: PT66739
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: MK93250
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: SM85227
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM85227%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for SM85227: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: CG03839
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: YJ11714
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ11714%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for YJ11714: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: NV96108
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: VY22890
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22890%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for VY22890: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: DS58679
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS58679%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for DS58679: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL85371%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for PL85371: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: VL80954
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: ZE45705
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: DE08744
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: EN22144
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: LA72906
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: MF16009
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF16009%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for MF16009: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: WK49027
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: KG21612
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG21612%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for KG21612: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: YV29892
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV29892%27 HTTP/1.1" 200 None
2026-03-28 10:57:10 [auto1.de] INFO: Scrape type for YV29892: 0
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: WZ80010
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: CC70262
2026-03-28 10:57:10 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-28 10:57:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:20 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 9684 | hits on page: 40
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: DV15520
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: CT94694
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY11260%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for KY11260: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: VV43208
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: KL57981
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL57981%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for KL57981: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: CU33421
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: PF93593
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK88220%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for AK88220: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: KS12992
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: FH56262
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH56262%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for FH56262: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: MG09905
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: MT78692
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT78692%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for MT78692: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: LS44265
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS44265%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for LS44265: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: TC94851
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: TM61103
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: KT77585
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT77585%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for KT77585: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: XB19891
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: TJ66673
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98688%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for CX98688: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: DH53166
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: ZE31778
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE31778%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for ZE31778: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: RD12421
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD12421%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for RD12421: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82708%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for SA82708: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: RJ07463
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: GE45533
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE45533%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for GE45533: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: GU99476
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU99476%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for GU99476: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: HF74785
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ70893%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for CZ70893: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: EZ84115
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ84115%27 HTTP/1.1" 200 None
2026-03-28 10:57:20 [auto1.de] INFO: Scrape type for EZ84115: 0
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: CF13145
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: EG69699
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: LZ69181
2026-03-28 10:57:20 [auto1.de] INFO: Found listing with ID: BC55078
2026-03-28 10:57:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:28 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 9685 | hits on page: 40
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: BC55078
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: RL63795
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL63795%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for RL63795: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: WG13195
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: NT25501
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT25501%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for NT25501: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM64848%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for CM64848: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: US44062
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: PA16133
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA16133%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for PA16133: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: TD01616
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: YV04916
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: ES00815
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ82092%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for VJ82092: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: EZ87167
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: AB91886
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91886%27 HTTP/1.1" 200 None
2026-03-28 10:57:28 [auto1.de] INFO: Scrape type for AB91886: 0
2026-03-28 10:57:28 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-28 10:57:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK49169%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for VK49169: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ86702%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for AZ86702: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: FZ73081
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ73081%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for FZ73081: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG98905%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for NG98905: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: ZZ70477
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: FG85844
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: FX17983
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17983%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for FX17983: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: LE68165
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE68165%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for LE68165: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: XV51445
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV51445%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for XV51445: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP50790%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for CP50790: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB05903%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for UB05903: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY49158%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for AY49158: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: NJ50287
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: NN96342
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN96342%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for NN96342: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: GX56948
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: MC19465
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: BK94626
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: ND36450
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND36450%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for ND36450: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: VB51991
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: NB13742
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB13742%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for NB13742: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: TH46997
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH46997%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for TH46997: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: EW90730
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: VN33107
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN33107%27 HTTP/1.1" 200 None
2026-03-28 10:57:29 [auto1.de] INFO: Scrape type for VN33107: 0
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: EE21023
2026-03-28 10:57:29 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-28 10:57:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:57:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 10:57:41 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 9686 | hits on page: 40
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: CX63821
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: JL38639
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL38639%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for JL38639: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: GR03981
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: GD37496
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: AM26890
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: PU65266
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: PW54296
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: HU83271
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU83271%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for HU83271: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB97674%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for ZB97674: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: FR08984
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: ZA36261
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM05292%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for RM05292: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: WC48972
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: VL97959
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: XP39668
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: TE02637
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE02637%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for TE02637: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: AJ02147
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ02147%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for AJ02147: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: JW75364
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: BY93360
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: LZ33123
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ33123%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for LZ33123: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU98141%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for UU98141: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK06472%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for CK06472: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: DW18994
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: TX71823
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: SH29410
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF77212%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for PF77212: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: FP38925
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14126%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for CU14126: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: FA52681
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW74456%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for HW74456: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 10:57:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF87432%27 HTTP/1.1" 200 None
2026-03-28 10:57:41 [auto1.de] INFO: Scrape type for JF87432: 0
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: AW42716
2026-03-28 10:57:41 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-28 10:57:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 10:58:06 [scrapy.extensions.logstats] INFO: Crawled 375 pages (at 5 pages/min), scraped 221 items (at 0 items/min)
2026-03-28 10:58:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:59:06 [scrapy.extensions.logstats] INFO: Crawled 375 pages (at 0 pages/min), scraped 221 items (at 0 items/min)
2026-03-28 10:59:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 10:59:52 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.920(s), this was the 1st time calling it.
2026-03-28 10:59:52 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.915112880616993 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 10:59:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 11:00:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:01 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14126%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for CU14126: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: FA52681
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW74456%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for HW74456: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF87432%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for JF87432: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: AW42716
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: PS70153
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: ZT34226
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT34226%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for ZT34226: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: TJ69662
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH70293%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for EH70293: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE68456%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for WE68456: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: GR93204
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR93204%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for GR93204: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: ME49426
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: VH05156
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH05156%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for VH05156: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: AJ94093
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ94093%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for AJ94093: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45367%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for ZE45367: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: KN83228
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: SX49755
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX49755%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for SX49755: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05859%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for JW05859: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST09245%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for ST09245: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: TE58325
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD50866%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for HD50866: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: PB84737
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: FX80004
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: CK93419
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH26353%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for EH26353: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: TT01449
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT01449%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for TT01449: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: RX36269
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX36269%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for RX36269: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: MS42398
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS42398%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for MS42398: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: NX20586
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX20586%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for NX20586: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: TY55277
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: XA91710
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA91710%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for XA91710: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD69180%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for CD69180: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: KD57513
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: PD68131
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD68131%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for PD68131: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: LZ01049
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ01049%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for LZ01049: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF81751%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for GF81751: 0
2026-03-28 11:00:01 [auto1.de] INFO: Found listing with ID: VY10328
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10328%27 HTTP/1.1" 200 None
2026-03-28 11:00:01 [auto1.de] INFO: Scrape type for VY10328: 0
2026-03-28 11:00:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:03 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: RC78324
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78324%27 HTTP/1.1" 200 None
2026-03-28 11:00:03 [auto1.de] INFO: Scrape type for RC78324: 0
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: BK70800
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: EN44355
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN44355%27 HTTP/1.1" 200 None
2026-03-28 11:00:03 [auto1.de] INFO: Scrape type for EN44355: 0
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58705%27 HTTP/1.1" 200 None
2026-03-28 11:00:03 [auto1.de] INFO: Scrape type for VN58705: 0
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: SX37933
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX37933%27 HTTP/1.1" 200 None
2026-03-28 11:00:03 [auto1.de] INFO: Scrape type for SX37933: 0
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: ZE74585
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU37583%27 HTTP/1.1" 200 None
2026-03-28 11:00:03 [auto1.de] INFO: Scrape type for VU37583: 0
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: PA55939
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: BH36406
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH36406%27 HTTP/1.1" 200 None
2026-03-28 11:00:03 [auto1.de] INFO: Scrape type for BH36406: 0
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP71706%27 HTTP/1.1" 200 None
2026-03-28 11:00:03 [auto1.de] INFO: Scrape type for FP71706: 0
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72456%27 HTTP/1.1" 200 None
2026-03-28 11:00:03 [auto1.de] INFO: Scrape type for FJ72456: 0
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB37125%27 HTTP/1.1" 200 None
2026-03-28 11:00:03 [auto1.de] INFO: Scrape type for RB37125: 0
2026-03-28 11:00:03 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-28 11:00:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01361%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for DX01361: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: GA16313
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA16313%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for GA16313: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: RC54937
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC54937%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for RC54937: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX99081%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for PX99081: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: US61717
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US61717%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for US61717: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV88353%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for NV88353: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05559%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for KG05559: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG81314%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for CG81314: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: CN28958
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN28958%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for CN28958: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK80095%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for LK80095: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: KY35163
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY35163%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for KY35163: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW15562%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for RW15562: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ54145%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for PJ54145: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: AA47357
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA47357%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for AA47357: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: XU32794
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU32794%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for XU32794: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB97805%27 HTTP/1.1" 200 None
2026-03-28 11:00:04 [auto1.de] INFO: Scrape type for NB97805: 0
2026-03-28 11:00:04 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-28 11:00:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:05 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE98094%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for DE98094: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF94363%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for XF94363: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY23917%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for GY23917: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW34309%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for YW34309: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: TL68134
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG69344%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for NG69344: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL97595%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for DL97595: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK08756%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for UK08756: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT49963%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for BT49963: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN37925%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for GN37925: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG58212%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for TG58212: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: ST20646
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: UF64612
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF64612%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for UF64612: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: LF59427
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT28740%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for DT28740: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL25204%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for LL25204: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: US56502
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW02543%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for NW02543: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD56647%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for CD56647: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT58505%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for GT58505: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: AD82327
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD82327%27 HTTP/1.1" 200 None
2026-03-28 11:00:05 [auto1.de] INFO: Scrape type for AD82327: 0
2026-03-28 11:00:05 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96543%27 HTTP/1.1" 200 None
2026-03-28 11:00:06 [auto1.de] INFO: Scrape type for XZ96543: 0
2026-03-28 11:00:06 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-28 11:00:06 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-28 11:00:06 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW77910%27 HTTP/1.1" 200 None
2026-03-28 11:00:06 [auto1.de] INFO: Scrape type for PW77910: 0
2026-03-28 11:00:06 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-28 11:00:06 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-28 11:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:06 [scrapy.extensions.logstats] INFO: Crawled 378 pages (at 3 pages/min), scraped 221 items (at 0 items/min)
2026-03-28 11:00:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:07 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:07 [auto1.de] INFO: Found listing with ID: KE33032
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE33032%27 HTTP/1.1" 200 None
2026-03-28 11:00:07 [auto1.de] INFO: Scrape type for KE33032: 0
2026-03-28 11:00:07 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-28 11:00:07 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-28 11:00:07 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-28 11:00:07 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ21667%27 HTTP/1.1" 200 None
2026-03-28 11:00:07 [auto1.de] INFO: Scrape type for LZ21667: 0
2026-03-28 11:00:07 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-28 11:00:07 [auto1.de] INFO: Found listing with ID: EP50641
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP50641%27 HTTP/1.1" 200 None
2026-03-28 11:00:07 [auto1.de] INFO: Scrape type for EP50641: 0
2026-03-28 11:00:07 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-28 11:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37955%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for MX37955: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: LX99570
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE53934%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for GE53934: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: LA20568
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA20568%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for LA20568: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM81365%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for NM81365: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: CR14297
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB00511%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for ZB00511: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT11127%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for WT11127: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE50485%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for CE50485: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH01499%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for RH01499: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA01752%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for TA01752: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36706%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for HD36706: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: EY40312
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY40312%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for EY40312: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH14315%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for GH14315: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ35604%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for LZ35604: 0
2026-03-28 11:00:08 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09551%27 HTTP/1.1" 200 None
2026-03-28 11:00:08 [auto1.de] INFO: Scrape type for WE09551: 0
2026-03-28 11:00:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:09 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH89346%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for YH89346: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: DT18968
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT18968%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for DT18968: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93445%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for NL93445: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF57615%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for WF57615: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR38354%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for CR38354: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: KD59460
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD59460%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for KD59460: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS42918%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for VS42918: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: AN41725
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67833%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for NK67833: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL85069%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for LL85069: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: NN27576
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM27166%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for CM27166: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: NX98593
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98593%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for NX98593: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH89031%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for FH89031: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: UK22144
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA37640%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for PA37640: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91844%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for MW91844: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ31172%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for GZ31172: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for JM75105: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: HF90366
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY55773%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for BY55773: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: LK57137
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56565%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for MK56565: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: NA93795
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA93795%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for NA93795: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK09737%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for UK09737: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU93663%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for EU93663: 0
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-28 11:00:09 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD99191%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [auto1.de] INFO: Scrape type for BD99191: 0
2026-03-28 11:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:11 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP19513%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for GP19513: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13980%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for YT13980: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA59196%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for SA59196: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39495%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for WN39495: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: DZ81579
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV09356%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for CV09356: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: ML18265
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML18265%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for ML18265: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: RT17429
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR51740%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for YR51740: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: CN48396
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN48396%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for CN48396: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX70218%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for MX70218: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ83535%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for XJ83535: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47398%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for YT47398: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR62561%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for XR62561: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: FF27762
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF27762%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for FF27762: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ04828%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for HJ04828: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM53714%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for VM53714: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: YY58464
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY58464%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for YY58464: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: AM53740
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: EM43051
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM43051%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for EM43051: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: FF42926
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ42381%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for WZ42381: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: TR57045
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: WM35972
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM35972%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for WM35972: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY51393%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for BY51393: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: LP84561
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP84561%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for LP84561: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED54075%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for ED54075: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS01911%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for GS01911: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90808%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for RD90808: 0
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-28 11:00:11 [auto1.de] INFO: Found listing with ID: DK79319
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK79319%27 HTTP/1.1" 200 None
2026-03-28 11:00:11 [auto1.de] INFO: Scrape type for DK79319: 0
2026-03-28 11:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:13 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:13 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-28 11:00:13 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-28 11:00:13 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND71699%27 HTTP/1.1" 200 None
2026-03-28 11:00:13 [auto1.de] INFO: Scrape type for ND71699: 0
2026-03-28 11:00:13 [auto1.de] INFO: Found listing with ID: PK53003
2026-03-28 11:00:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK53003%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for PK53003: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: VR97101
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR97101%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for VR97101: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN05925%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for ZN05925: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ10151%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for PZ10151: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM26089%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for BM26089: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF17826%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for UF17826: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: XH45962
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: ME71615
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: TT01725
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: JU24263
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU24263%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for JU24263: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF39104%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for LF39104: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71458%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for WJ71458: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA42625%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for TA42625: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: VD73221
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY64031%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for GY64031: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD55722%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for MD55722: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63230%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for UK63230: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH48062%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for RH48062: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: YE44037
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: PH72669
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW65379%27 HTTP/1.1" 200 None
2026-03-28 11:00:14 [auto1.de] INFO: Scrape type for KW65379: 0
2026-03-28 11:00:14 [auto1.de] INFO: Found listing with ID: RX15047
2026-03-28 11:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:15 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 9692 | hits on page: 40
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: SY58085
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR52886%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for XR52886: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ60217%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for BZ60217: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW02228%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for HW02228: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR27730%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for XR27730: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL62100%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for HL62100: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: SR36375
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM98978%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for TM98978: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: YM65091
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM65091%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for YM65091: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV10952%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for WV10952: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: DX69622
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX69622%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for DX69622: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: ZL39165
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL39165%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for ZL39165: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: LX80768
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX80768%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for LX80768: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: JX03592
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27450%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for FP27450: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW45885%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for WW45885: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: AM12190
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: RJ67815
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ67815%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for RJ67815: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH30720%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for GH30720: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: ZY51606
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY51606%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for ZY51606: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: RL99236
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL99236%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for RL99236: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ28276%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for HJ28276: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF73158%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for FF73158: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91695%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for FT91695: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF58190%27 HTTP/1.1" 200 None
2026-03-28 11:00:15 [auto1.de] INFO: Scrape type for UF58190: 0
2026-03-28 11:00:15 [auto1.de] INFO: Found listing with ID: YS34341
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:20 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 9693 | hits on page: 40
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: YS34341
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: SR10542
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR10542%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for SR10542: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: KJ72573
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN99491%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for SN99491: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA89472%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for EA89472: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV01596%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for TV01596: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV90195%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for VV90195: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98956%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for VV98956: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK85869%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for RK85869: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: JG05380
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN65231%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for ZN65231: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT11802%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for HT11802: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT28876%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for NT28876: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW65482%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for CW65482: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT83472%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for TT83472: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: NP38313
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP38313%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for NP38313: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW82569%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for WW82569: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ88633%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for HJ88633: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ95747%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for HZ95747: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46416%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for VP46416: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: UR28246
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR28246%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for UR28246: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-28 11:00:20 [auto1.de] INFO: Scrape type for LK46158: 0
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: WE47362
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: BP64224
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-28 11:00:20 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-28 11:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:37 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 9694 | hits on page: 40
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF69391%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for RF69391: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87592%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for AR87592: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT53290%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for DT53290: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: US86443
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: SZ20099
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ20099%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for SZ20099: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ34801%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for BJ34801: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: LM23277
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM23277%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for LM23277: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: VM20095
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM20095%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for VM20095: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH43917%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for BH43917: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: WA68038
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92076%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for TX92076: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR24224%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for UR24224: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: TC39973
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH02928%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for MH02928: 0
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-28 11:00:37 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28734%27 HTTP/1.1" 200 None
2026-03-28 11:00:37 [auto1.de] INFO: Scrape type for UT28734: 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: YX67220
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG38985%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for VG38985: 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: CC63606
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC63606%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for CC63606: 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU49323%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for GU49323: 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: SY49649
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY49649%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for SY49649: 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: EA35621
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA35621%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for EA35621: 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ38457%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for SZ38457: 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR65686%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for FR65686: 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP95286%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for ZP95286: 0
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-28 11:00:38 [auto1.de] INFO: Found listing with ID: DB64209
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64209%27 HTTP/1.1" 200 None
2026-03-28 11:00:38 [auto1.de] INFO: Scrape type for DB64209: 0
2026-03-28 11:00:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:42 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 9694 | hits on page: 40
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: XG90247
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF07638%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for HF07638: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE55813%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for PE55813: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: KN40291
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: EP13780
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE02336%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for FE02336: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN96808%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for UN96808: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: FK17094
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK17094%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for FK17094: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: GY29041
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: NB41059
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85358%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for ZS85358: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY00431%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for EY00431: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH70992%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for MH70992: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM92730%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for PM92730: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: YC14273
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11435%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for MX11435: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: UD03401
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH53134%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for BH53134: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB14997%27 HTTP/1.1" 200 None
2026-03-28 11:00:42 [auto1.de] INFO: Scrape type for BB14997: 0
2026-03-28 11:00:42 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-28 11:00:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:00:50 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 9694 | hits on page: 40
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94588%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for SX94588: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24484%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for AF24484: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA25019%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for GA25019: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: XY13260
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13260%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for XY13260: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU80256%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for CU80256: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD57805%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for TD57805: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37163%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for BG37163: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21396%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for CS21396: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: SM01273
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM01273%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for SM01273: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC06569%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for TC06569: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: MW24531
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW24531%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for MW24531: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS56665%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for ZS56665: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU39005%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for AU39005: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98877%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for MC98877: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB91178%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for JB91178: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: XC03196
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP56939%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for XP56939: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ97003%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for BJ97003: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: LM23776
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR63212%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for DR63212: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: JX94750
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: HF95044
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF95044%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for HF95044: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD46064%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for BD46064: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81385%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for FT81385: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG80172%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for UG80172: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH56246%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for CH56246: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ30357%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for XJ30357: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW20696%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for ZW20696: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE57502%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for AE57502: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW15579%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for VW15579: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV70498%27 HTTP/1.1" 200 None
2026-03-28 11:00:50 [auto1.de] INFO: Scrape type for WV70498: 0
2026-03-28 11:00:50 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-28 11:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:06 [scrapy.extensions.logstats] INFO: Crawled 387 pages (at 9 pages/min), scraped 221 items (at 0 items/min)
2026-03-28 11:01:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:26 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 9695 | hits on page: 40
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: HY44820
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY44820%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for HY44820: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR50591%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for KR50591: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG32866%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for MG32866: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE47018%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for JE47018: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: BC55238
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55238%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for BC55238: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE25486%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for NE25486: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: EU79522
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: GB06112
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85293%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for VE85293: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM12960%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for ZM12960: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY72629%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for KY72629: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX04518%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for XX04518: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: DD75704
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB82459%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for BB82459: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR95726%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for PR95726: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: GD94129
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD94129%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for GD94129: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG49368%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for PG49368: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: LB24374
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: JV29495
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP07382%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for FP07382: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE84104%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [auto1.de] INFO: Scrape type for DE84104: 0
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: KJ31397
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-28 11:01:26 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-28 11:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:44 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 9697 | hits on page: 40
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU85370%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for FU85370: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC52904%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for BC52904: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: MJ97725
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST81436%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for ST81436: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX03618%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for MX03618: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR04951%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for AR04951: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: NB03512
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: YN70037
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN70037%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for YN70037: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA65377%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for HA65377: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: ED74912
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74912%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for ED74912: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX39792%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for FX39792: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC95378%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for AC95378: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW63428%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for KW63428: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: RV27328
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27328%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for RV27328: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: HB28048
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB28048%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for HB28048: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA56984%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for TA56984: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: BJ89189
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ89189%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for BJ89189: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: YJ80540
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: HT24109
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24109%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for HT24109: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD70157%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [auto1.de] INFO: Scrape type for MD70157: 0
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: DS73409
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-28 11:01:44 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-28 11:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:45 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 9697 | hits on page: 40
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB25361%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.de] INFO: Scrape type for UB25361: 0
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13721%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.de] INFO: Scrape type for CD13721: 0
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: HV05034
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: KT12988
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT12988%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [auto1.de] INFO: Scrape type for KT12988: 0
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-28 11:01:45 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06555%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for VN06555: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: YG16236
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00518%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for HE00518: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK34658%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for MK34658: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS04135%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for KS04135: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86569%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for XC86569: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: AZ75969
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ75969%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for AZ75969: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR89322%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for GR89322: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09029%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for GF09029: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: HR56257
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR56257%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for HR56257: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17316%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for NS17316: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN78451%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for AN78451: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM68343%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for AM68343: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: KA05574
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45023%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for SL45023: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC93517%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for MC93517: 0
2026-03-28 11:01:46 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN86617%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [auto1.de] INFO: Scrape type for PN86617: 0
2026-03-28 11:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:52 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 9697 | hits on page: 40
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41479%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for MF41479: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: VF13288
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF13288%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for VF13288: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK58652%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for FK58652: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: JU03795
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: RB44487
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB44487%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for RB44487: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: GD38856
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD38856%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for GD38856: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX50427%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for VX50427: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41961%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for AM41961: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY92753%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for PY92753: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: KR05534
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU43264%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for RU43264: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT62931%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for YT62931: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67029%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for HB67029: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS38799%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for GS38799: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW61170%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for VW61170: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: TU77981
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC77037%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for AC77037: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA79270%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for UA79270: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ50241%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for SZ50241: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: HP73171
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG81564%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for EG81564: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM56533%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for HM56533: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV91199%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for NV91199: 0
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: RR39705
2026-03-28 11:01:52 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64157%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [auto1.de] INFO: Scrape type for XW64157: 0
2026-03-28 11:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:53 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 9697 | hits on page: 40
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT78842%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for FT78842: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: RS29820
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB21266%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for VB21266: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE41778%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for DE41778: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: HR99105
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR99105%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for HR99105: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR84974%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for KR84974: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: CJ52428
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: CX13035
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX13035%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for CX13035: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW18097%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for VW18097: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS96658%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for AS96658: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: FJ74822
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ74822%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for FJ74822: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM78825%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for BM78825: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU28825%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for MU28825: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE22331%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for DE22331: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR63828%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for ZR63828: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN32284%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for NN32284: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT21792%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for MT21792: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90770%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for NG90770: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35717%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for PB35717: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: LG96473
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP74565%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for EP74565: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: CC79816
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC79816%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for CC79816: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ57500%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for SJ57500: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: GH24213
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH24213%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for GH24213: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: WV66084
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD67065%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [auto1.de] INFO: Scrape type for CD67065: 0
2026-03-28 11:01:53 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD28635%27 HTTP/1.1" 200 None
2026-03-28 11:01:54 [auto1.de] INFO: Scrape type for WD28635: 0
2026-03-28 11:01:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:01:58 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 9697 | hits on page: 40
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: HC51034
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: YY26065
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY26065%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for YY26065: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: LD89298
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: AX72910
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE37083%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for DE37083: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE15038%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for CE15038: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG10671%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for BG10671: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME01390%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for ME01390: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL40939%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for TL40939: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF47459%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for YF47459: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC12469%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for MC12469: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: VC37010
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW03247%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for GW03247: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE95129%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for WE95129: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: SB06685
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55546%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for SY55546: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD35847%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for WD35847: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: DV41071
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41071%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for DV41071: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM05172%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for BM05172: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28924%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for ZF28924: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE62268%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for TE62268: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43321%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for BA43321: 0
2026-03-28 11:01:58 [auto1.de] INFO: Found listing with ID: NW01824
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01824%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [auto1.de] INFO: Scrape type for NW01824: 0
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN01043%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [auto1.de] INFO: Scrape type for VN01043: 0
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX77194%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [auto1.de] INFO: Scrape type for SX77194: 0
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY62389%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [auto1.de] INFO: Scrape type for EY62389: 0
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT67219%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [auto1.de] INFO: Scrape type for MT67219: 0
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: HR15403
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: RA84296
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-28 11:01:59 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-28 11:01:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:00 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 9697 | hits on page: 40
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN28121%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for NN28121: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: VG06126
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG06126%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for VG06126: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: AG71347
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG71347%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for AG71347: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX01041%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for MX01041: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT23330%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for ZT23330: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54184%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for JP54184: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51325%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for VS51325: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: ZV51045
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR11157%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for YR11157: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW76685%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for ZW76685: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: WM07863
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: RS51050
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS51050%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for RS51050: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45431%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for DC45431: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX92669%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for JX92669: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: MT04739
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY76053%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for DY76053: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: XZ00200
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: GD72081
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD72081%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for GD72081: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: NN04046
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP10978%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for HP10978: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB70760%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for FB70760: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: BB09441
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB09441%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for BB09441: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: AW92079
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92079%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [auto1.de] INFO: Scrape type for AW92079: 0
2026-03-28 11:02:00 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-28 11:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:04 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 9697 | hits on page: 40
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23740%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for AZ23740: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: RN79752
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: TG99958
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: WV47854
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV47854%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for WV47854: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: ZJ08773
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08773%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for ZJ08773: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV69297%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for AV69297: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV15826%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for SV15826: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC15982%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for UC15982: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB42809%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for FB42809: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN70453%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for GN70453: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF47074%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for EF47074: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: HY62666
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY62666%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for HY62666: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV09122%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for FV09122: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52581%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for WJ52581: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30704%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for PY30704: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR36805%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for XR36805: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78048%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for FJ78048: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS28030%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for SS28030: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30583%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for JY30583: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17953%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for CS17953: 0
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: PD22194
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-28 11:02:04 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV00892%27 HTTP/1.1" 200 None
2026-03-28 11:02:04 [auto1.de] INFO: Scrape type for NV00892: 0
2026-03-28 11:02:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:06 [scrapy.extensions.logstats] INFO: Crawled 395 pages (at 8 pages/min), scraped 221 items (at 0 items/min)
2026-03-28 11:02:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:13 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 9698 | hits on page: 40
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV00892%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for NV00892: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: CZ31886
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ31886%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for CZ31886: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: CL03195
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03195%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for CL03195: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: TN12094
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN12094%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for TN12094: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: PY36433
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY36433%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for PY36433: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL23415%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for AL23415: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB15916%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for PB15916: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27927%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for BX27927: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF73856%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for ZF73856: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: YX04604
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: SR70263
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR70263%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for SR70263: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: WJ48379
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ48379%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for WJ48379: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: NA05625
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA05625%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for NA05625: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: LA17342
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA17342%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for LA17342: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: CP64616
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER30285%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for ER30285: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: YV88881
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS79013%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for BS79013: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: XW21261
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: RN83637
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN83637%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for RN83637: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: VX93609
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX93609%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for VX93609: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47877%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for XV47877: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY51014%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for WY51014: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: CY67531
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC90935%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for SC90935: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15707%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for RP15707: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: EF86082
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14062%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for JM14062: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP84657%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for WP84657: 0
2026-03-28 11:02:13 [auto1.de] INFO: Found listing with ID: DX83058
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX83058%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [auto1.de] INFO: Scrape type for DX83058: 0
2026-03-28 11:02:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:32 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 9698 | hits on page: 40
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP14792%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for FP14792: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: ZA30968
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA30968%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for ZA30968: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: RZ98922
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ98922%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for RZ98922: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG49246%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for RG49246: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: ED07597
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: TR63216
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR63216%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for TR63216: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: FA61594
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA61594%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for FA61594: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB30393%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for TB30393: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: SP08055
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: YM37957
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: VX80361
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX80361%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for VX80361: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ97529%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for NZ97529: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV65540%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for HV65540: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: VF52184
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61703%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for KZ61703: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT58589%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for LT58589: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM99082%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for ZM99082: 0
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-28 11:02:32 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX93034%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [auto1.de] INFO: Scrape type for ZX93034: 0
2026-03-28 11:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:41 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 9699 | hits on page: 40
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX93034%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Scrape type for ZX93034: 0
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML30380%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Scrape type for ML30380: 0
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH59538%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Scrape type for YH59538: 0
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP37775%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Scrape type for NP37775: 0
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: ZC13523
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: ZD82611
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD82611%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Scrape type for ZD82611: 0
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE50897%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [auto1.de] INFO: Scrape type for KE50897: 0
2026-03-28 11:02:41 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV67492%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for FV67492: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL77544%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for DL77544: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: BE55257
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS05974%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for TS05974: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: VD13122
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD13122%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for VD13122: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: ME79930
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA63852%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for FA63852: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK15614%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for FK15614: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: XG45401
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG45401%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for XG45401: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: EJ14046
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK98414%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for KK98414: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU97666%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for VU97666: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM38981%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for SM38981: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV53792%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for PV53792: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV91582%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for TV91582: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP20467%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for MP20467: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97428%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for YY97428: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: JB06991
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB06991%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for JB06991: 0
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: NN29635
2026-03-28 11:02:42 [auto1.de] INFO: Found listing with ID: SU34642
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU34642%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [auto1.de] INFO: Scrape type for SU34642: 0
2026-03-28 11:02:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:02:44 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 9699 | hits on page: 40
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP61348%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for VP61348: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05555%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for RT05555: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: GZ05428
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL72774%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for WL72774: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM72305%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for KM72305: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN65963%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for EN65963: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ89642%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for NZ89642: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD93182%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for MD93182: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: CJ40917
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ40917%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for CJ40917: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: JA99726
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: GJ23792
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: SJ81609
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ81609%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for SJ81609: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: WJ23528
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU90865%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for CU90865: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: XE45895
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: BN88120
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: YT80911
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: RP62848
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ18082%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for HZ18082: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ79041%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for BZ79041: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: JJ98035
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ98035%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for JJ98035: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA53170%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for MA53170: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH58090%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for EH58090: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX99530%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for MX99530: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: LN28697
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN28697%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for LN28697: 0
2026-03-28 11:02:44 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB72166%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [auto1.de] INFO: Scrape type for TB72166: 0
2026-03-28 11:02:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:01 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB72166%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for TB72166: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB36710%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for DB36710: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: JY30766
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30766%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for JY30766: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: RF64064
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF64064%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for RF64064: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: EY31921
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: GG87690
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG87690%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for GG87690: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: FA75858
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU40538%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for BU40538: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: WN52333
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN52333%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for WN52333: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: PA40823
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA40823%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for PA40823: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: AA44397
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA44397%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for AA44397: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA82816%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for KA82816: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: HU51237
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU51237%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for HU51237: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC78051%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for PC78051: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC54043%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [auto1.de] INFO: Scrape type for YC54043: 0
2026-03-28 11:03:01 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC35648%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Scrape type for UC35648: 0
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68185%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Scrape type for AE68185: 0
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: EM52017
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM52017%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Scrape type for EM52017: 0
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV46611%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Scrape type for EV46611: 0
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS39817%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Scrape type for MS39817: 0
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: US51436
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN25126%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Scrape type for RN25126: 0
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA92521%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [auto1.de] INFO: Scrape type for TA92521: 0
2026-03-28 11:03:02 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-28 11:03:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:03 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: UD22753
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: UE75515
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT80809%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for NT80809: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF36424%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for JF36424: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: YF40819
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV42869%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for RV42869: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD08059%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for CD08059: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17125%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for UD17125: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: LD62620
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD62620%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for LD62620: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: US02257
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02257%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for US02257: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX67630%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for FX67630: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: XJ90591
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ90591%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for XJ90591: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: FR11509
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR11509%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for FR11509: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS04042%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for CS04042: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: PE84798
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE84798%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for PE84798: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH59067%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for FH59067: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: DS16746
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS16746%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for DS16746: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: RY43814
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: ER23285
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17671%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for XF17671: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: NA61105
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: WM57318
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: CJ16536
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: FW84422
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84422%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for FW84422: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: MX67239
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: AM76407
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM76407%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for AM76407: 0
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: XR91127
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-28 11:03:03 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH02243%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [auto1.de] INFO: Scrape type for RH02243: 0
2026-03-28 11:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:04 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ50890%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for PJ50890: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: AL22158
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: WK68156
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK68156%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for WK68156: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: FW15775
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15775%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for FW15775: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: YY67246
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: RM23787
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM23787%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for RM23787: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY55181%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for AY55181: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: NP91596
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP91596%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for NP91596: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB58565%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for VB58565: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK86210%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for AK86210: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: GZ90473
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ90473%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for GZ90473: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: YG40047
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: JA36918
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: UD76012
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: CE30304
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE30304%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for CE30304: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: PD48755
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD48755%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for PD48755: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: DF55322
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG28413%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for NG28413: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG25993%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for HG25993: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV07522%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for AV07522: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: FV18875
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: BJ39418
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ39418%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for BJ39418: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71162%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for BM71162: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92334%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for KC92334: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR44160%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for ZR44160: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: RB15506
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: ZR64045
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR64045%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [auto1.de] INFO: Scrape type for ZR64045: 0
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: TZ06235
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: WS17164
2026-03-28 11:03:04 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-28 11:03:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:05 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:05 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90361%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for SE90361: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: EU47039
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: CM43625
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM43625%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for CM43625: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC04825%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for ZC04825: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG87332%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for LG87332: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: PY18559
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY18559%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for PY18559: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: MN13665
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: UJ44809
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ44809%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for UJ44809: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: ZC16188
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC16188%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for ZC16188: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: SK97361
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK97361%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for SK97361: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: DD55513
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX37368%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for JX37368: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: TT34866
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: HS97116
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS97116%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for HS97116: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: MW11829
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: SZ87491
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: HN55751
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: VY03646
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY03646%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for VY03646: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: WY86449
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY86449%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for WY86449: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: WL89525
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: XS52651
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS52651%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for XS52651: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: SZ51903
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ51903%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for SZ51903: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: FL69651
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL69651%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for FL69651: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: FP03650
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU37680%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for HU37680: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG74367%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for YG74367: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG24809%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [auto1.de] INFO: Scrape type for HG24809: 0
2026-03-28 11:03:06 [auto1.de] INFO: Found listing with ID: LF60633
2026-03-28 11:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:06 [scrapy.extensions.logstats] INFO: Crawled 403 pages (at 8 pages/min), scraped 221 items (at 0 items/min)
2026-03-28 11:03:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:07 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE56014%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for GE56014: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: VZ02444
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: FH65509
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: CU18716
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU18716%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for CU18716: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: WJ85082
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ85082%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for WJ85082: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: TF47894
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF47894%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for TF47894: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: MX28919
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX28919%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for MX28919: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: XF17082
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17082%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for XF17082: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: VZ57974
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: CU58211
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: CT99178
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT99178%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for CT99178: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK53162%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for ZK53162: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: BU19474
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU19474%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for BU19474: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: LX20834
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: RS53381
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: FR48233
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: VC03178
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: AT04961
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT04961%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for AT04961: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: DP93170
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: MK25304
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK25304%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for MK25304: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL67140%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for VL67140: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: PV23410
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: YT49063
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: FE23921
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: RR91619
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: HM21196
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM21196%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for HM21196: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85812%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for XB85812: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK64805%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [auto1.de] INFO: Scrape type for AK64805: 0
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: NK67778
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: TV50499
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: RT04341
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: LK78383
2026-03-28 11:03:07 [auto1.de] INFO: Found listing with ID: RH95863
2026-03-28 11:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:12 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: DT99526
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT99526%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for DT99526: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: TL32343
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: NK05730
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: NY96837
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: CW06535
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: SZ37158
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: ZE95100
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE95100%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for ZE95100: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: XK27021
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK27021%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for XK27021: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: NK77096
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: JL68232
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: WN51160
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN51160%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for WN51160: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: ED55965
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: EB27045
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: MB48491
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: JR79236
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR79236%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for JR79236: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: XH89248
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ25719%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for VZ25719: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: XM39698
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: YP47874
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP47874%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for YP47874: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: AU99982
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU99982%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for AU99982: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY60596%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for HY60596: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY94594%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for AY94594: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: CM78199
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78199%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for CM78199: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG01662%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for CG01662: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: XE06638
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE06638%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for XE06638: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: XC20184
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: TW13952
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW13952%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for TW13952: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: SW03797
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: MG59834
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG59834%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for MG59834: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV08426%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for UV08426: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: LU31167
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: EK22988
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: DA26658
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH17233%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for BH17233: 0
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: LN54232
2026-03-28 11:03:12 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR69108%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [auto1.de] INFO: Scrape type for DR69108: 0
2026-03-28 11:03:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:13 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: UL22027
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL22027%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for UL22027: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP77608%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for PP77608: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL94841%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for JL94841: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: GA30636
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: JZ10962
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ10962%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for JZ10962: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: NF93204
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF93204%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for NF93204: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: KK91293
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK91293%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for KK91293: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: UM89266
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: CV45473
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV45473%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for CV45473: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: RD20926
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD20926%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for RD20926: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: BE69284
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE69284%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for BE69284: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: VE40725
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: KM24929
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM24929%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for KM24929: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: FS97701
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: DF26207
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF26207%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for DF26207: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: GA77173
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: YZ37730
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ37730%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for YZ37730: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: XX78597
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: LN26103
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26103%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for LN26103: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: AN38948
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN38948%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for AN38948: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: KZ05570
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05570%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for KZ05570: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: YV73538
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: LW15406
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW15406%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for LW15406: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: KU78731
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU78731%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for KU78731: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: PN43025
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN43025%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for PN43025: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: TW48699
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW48699%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for TW48699: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: HX62620
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX62620%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for HX62620: 0
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: PD71224
2026-03-28 11:03:13 [auto1.de] INFO: Found listing with ID: DN90416
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN90416%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [auto1.de] INFO: Scrape type for DN90416: 0
2026-03-28 11:03:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:17 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:17 [auto1.de] INFO: Found listing with ID: GG89436
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89436%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [auto1.de] INFO: Scrape type for GG89436: 0
2026-03-28 11:03:17 [auto1.de] INFO: Found listing with ID: SJ33830
2026-03-28 11:03:17 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD28346%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [auto1.de] INFO: Scrape type for DD28346: 0
2026-03-28 11:03:17 [auto1.de] INFO: Found listing with ID: NE75834
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE75834%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for NE75834: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: RL39827
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL21750%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for JL21750: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: AB28223
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB28223%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for AB28223: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV51967%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for DV51967: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: CN50169
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN50169%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for CN50169: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: HH76288
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX86126%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for KX86126: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM13407%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for SM13407: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP61239%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for BP61239: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40216%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for ZU40216: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: US13530
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY66130%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for CY66130: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: GX42293
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY09014%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for FY09014: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC44419%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for YC44419: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: ML17835
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: GW12084
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW12084%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for GW12084: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for SM63646: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX96959%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for GX96959: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN44091%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for HN44091: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB02361%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for YB02361: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46932%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for CM46932: 0
2026-03-28 11:03:18 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64816%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [auto1.de] INFO: Scrape type for AV64816: 0
2026-03-28 11:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:22 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM55237%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for YM55237: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: CL86241
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL86241%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for CL86241: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV60507%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for JV60507: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW56593%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for LW56593: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR64184%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for BR64184: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY33433%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for AY33433: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM37211%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for CM37211: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: UR07800
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: KD93496
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: AL86714
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW17525%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for EW17525: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC65369%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for BC65369: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC89740%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for VC89740: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX20587%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for CX20587: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU12004%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for CU12004: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT65842%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for CT65842: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS84197%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for PS84197: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL84937%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for TL84937: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW88785%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for ZW88785: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75597%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for NY75597: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP80486%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [auto1.de] INFO: Scrape type for DP80486: 0
2026-03-28 11:03:22 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78580%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [auto1.de] INFO: Scrape type for UC78580: 0
2026-03-28 11:03:23 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU16772%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [auto1.de] INFO: Scrape type for MU16772: 0
2026-03-28 11:03:23 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-28 11:03:23 [auto1.de] INFO: Found listing with ID: SJ16961
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ16961%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [auto1.de] INFO: Scrape type for SJ16961: 0
2026-03-28 11:03:23 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ99289%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [auto1.de] INFO: Scrape type for XJ99289: 0
2026-03-28 11:03:23 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA55761%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [auto1.de] INFO: Scrape type for BA55761: 0
2026-03-28 11:03:23 [auto1.de] INFO: Found listing with ID: VV03137
2026-03-28 11:03:23 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-28 11:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:24 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU48092%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for GU48092: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: ZS51994
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB50178%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for VB50178: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY31624%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for ZY31624: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30485%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for VN30485: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: NP21854
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP21854%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for NP21854: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: NT84064
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT84064%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for NT84064: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU39624%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for FU39624: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: NB66943
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL15511%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for AL15511: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: NK75745
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75745%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for NK75745: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: XT22823
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: AX94045
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: DZ46281
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ46281%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for DZ46281: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: XF90946
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: NJ92771
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH75951%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for VH75951: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59851%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for UA59851: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL92267%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for EL92267: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP66388%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for ZP66388: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW69161%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for DW69161: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK25487%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [auto1.de] INFO: Scrape type for BK25487: 0
2026-03-28 11:03:24 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-28 11:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:41 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: AE68342
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55380%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for LV55380: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ84842%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for DZ84842: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP30050%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for EP30050: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64139%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for DB64139: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11616%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for BX11616: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: AX67376
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT28462%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for FT28462: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63570%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for TN63570: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK96887%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for WK96887: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ16162%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for MJ16162: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU53159%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for FU53159: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA54240%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for CA54240: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: VW08133
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW08133%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for VW08133: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10723%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for PA10723: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: LC14083
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: PM13070
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: FN69423
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW22041%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for XW22041: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: EF60692
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF60692%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for EF60692: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS31762%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for SS31762: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX72009%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for SX72009: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM14327%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for XM14327: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: DR21754
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR21754%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for DR21754: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU35390%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for AU35390: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: YL43717
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL43717%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for YL43717: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: FH11160
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70837%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for DM70837: 0
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-28 11:03:41 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV55154%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [auto1.de] INFO: Scrape type for MV55154: 0
2026-03-28 11:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:03:45 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 9700 | hits on page: 40
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: ZM43235
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM43235%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Scrape type for ZM43235: 0
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH75769%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Scrape type for CH75769: 0
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01853%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Scrape type for VR01853: 0
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ26339%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Scrape type for SJ26339: 0
2026-03-28 11:03:45 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR25014%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [auto1.de] INFO: Scrape type for VR25014: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX71998%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for AX71998: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL85831%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for WL85831: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67551%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for MS67551: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: FP53719
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN41265%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for PN41265: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB50562%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for UB50562: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP54397%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for GP54397: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT01639%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for WT01639: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94447%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for CJ94447: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM79272%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for JM79272: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS08913%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for DS08913: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: EX24606
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX24606%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for EX24606: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: AE65824
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE65824%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for AE65824: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: GE88369
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE88369%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for GE88369: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: TG88062
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG88062%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for TG88062: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU99321%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for YU99321: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38151%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for BV38151: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW23884%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for UW23884: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14078%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for UC14078: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: XG19073
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG19073%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for XG19073: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39086%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for VW39086: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL76772%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for TL76772: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA61541%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [auto1.de] INFO: Scrape type for MA61541: 0
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-28 11:03:46 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-28 11:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:06 [scrapy.extensions.logstats] INFO: Crawled 411 pages (at 8 pages/min), scraped 221 items (at 0 items/min)
2026-03-28 11:04:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:24 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 9701 | hits on page: 40
2026-03-28 11:04:24 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-28 11:04:24 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-28 11:04:24 [auto1.de] INFO: Found listing with ID: VV99941
2026-03-28 11:04:24 [auto1.de] INFO: Found listing with ID: BY90710
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY90710%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [auto1.de] INFO: Scrape type for BY90710: 2
2026-03-28 11:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30986627-4795-5964-a386-2181452c2a6e with identifier: BY90710
2026-03-28 11:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30986627-4795-5964-a386-2181452c2a6e with scrape type 2
2026-03-28 11:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30986627-4795-5964-a386-2181452c2a6e with scrape type 2
2026-03-28 11:04:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30986627-4795-5964-a386-2181452c2a6e, identifier: BY90710
2026-03-28 11:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30986627-4795-5964-a386-2181452c2a6e with identifier: BY90710
2026-03-28 11:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30986627-4795-5964-a386-2181452c2a6e with identifier: BY90710
2026-03-28 11:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30986627-4795-5964-a386-2181452c2a6e with identifier: BY90710 to the API
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:57:10Z',
 'fuel_type': 'diesel',
 'id': '30986627-4795-5964-a386-2181452c2a6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY90710',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 244350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-27',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2012}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY90710%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [auto1.de] INFO: Saving data for BY90710: {'auction_closing_time': 1774717030.0, 'created_time': 1774608351.982587, 'last_price_update_time': 1774695864.853199}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY90710') HTTP/1.1" 204 0
2026-03-28 11:04:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:24 [auto1.de] INFO: Found listing with ID: KV84804
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84804%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [auto1.de] INFO: Scrape type for KV84804: 2
2026-03-28 11:04:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c218447f-2f05-5fb8-b352-abe4d5938aad with identifier: KV84804
2026-03-28 11:04:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c218447f-2f05-5fb8-b352-abe4d5938aad with scrape type 2
2026-03-28 11:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c218447f-2f05-5fb8-b352-abe4d5938aad with scrape type 2
2026-03-28 11:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c218447f-2f05-5fb8-b352-abe4d5938aad, identifier: KV84804
2026-03-28 11:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c218447f-2f05-5fb8-b352-abe4d5938aad with identifier: KV84804
2026-03-28 11:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c218447f-2f05-5fb8-b352-abe4d5938aad with identifier: KV84804
2026-03-28 11:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c218447f-2f05-5fb8-b352-abe4d5938aad with identifier: KV84804 to the API
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:50:46Z',
 'fuel_type': 'diesel',
 'id': 'c218447f-2f05-5fb8-b352-abe4d5938aad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV84804',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 156275,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-27',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84804%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [auto1.de] INFO: Saving data for KV84804: {'auction_closing_time': 1774716646.0, 'created_time': 1774608352.685398, 'last_price_update_time': 1774695865.421718}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV84804') HTTP/1.1" 204 0
2026-03-28 11:04:25 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-28 11:04:25 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [auto1.de] INFO: Scrape type for CR70146: 2
2026-03-28 11:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146
2026-03-28 11:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53f36514-15a5-5ecd-b3ef-379629d48d5a with scrape type 2
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53f36514-15a5-5ecd-b3ef-379629d48d5a with scrape type 2
2026-03-28 11:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53f36514-15a5-5ecd-b3ef-379629d48d5a, identifier: CR70146
2026-03-28 11:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146
2026-03-28 11:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146
2026-03-28 11:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53f36514-15a5-5ecd-b3ef-379629d48d5a with identifier: CR70146 to the API
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:33:52Z',
 'fuel_type': 'petrol',
 'id': '53f36514-15a5-5ecd-b3ef-379629d48d5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR70146',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 68596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-07',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 MyLive',
 'transmission': 'manual',
 'trim': 'MyLive',
 'year': 2011}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [auto1.de] INFO: Saving data for CR70146: {'auction_closing_time': 1774715632.0, 'created_time': 1774608336.591064, 'last_price_update_time': 1774695865.853296}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR70146') HTTP/1.1" 204 0
2026-03-28 11:04:25 [auto1.de] INFO: Found listing with ID: MT40428
2026-03-28 11:04:25 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-28 11:04:25 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-28 11:04:25 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-28 11:04:25 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [auto1.de] INFO: Scrape type for JM16548: 2
2026-03-28 11:04:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548
2026-03-28 11:04:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8049887e-e6ec-5ec0-b934-32ee67f4586a with scrape type 2
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8049887e-e6ec-5ec0-b934-32ee67f4586a with scrape type 2
2026-03-28 11:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8049887e-e6ec-5ec0-b934-32ee67f4586a, identifier: JM16548
2026-03-28 11:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548
2026-03-28 11:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548
2026-03-28 11:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8049887e-e6ec-5ec0-b934-32ee67f4586a with identifier: JM16548 to the API
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:11:27Z',
 'fuel_type': 'petrol',
 'id': '8049887e-e6ec-5ec0-b934-32ee67f4586a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM16548',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 119026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-28',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2009}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.de] INFO: Saving data for JM16548: {'auction_closing_time': 1774714287.0, 'created_time': 1774608349.382555, 'last_price_update_time': 1774695866.327371}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM16548') HTTP/1.1" 204 0
2026-03-28 11:04:26 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-28 11:04:26 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-28 11:04:26 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-28 11:04:26 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.de] INFO: Scrape type for KL79607: 2
2026-03-28 11:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607
2026-03-28 11:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b with scrape type 2
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4cc6305-3dc3-5963-9880-cd5df1c48e9b with scrape type 2
2026-03-28 11:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4cc6305-3dc3-5963-9880-cd5df1c48e9b, identifier: KL79607
2026-03-28 11:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607
2026-03-28 11:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607
2026-03-28 11:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4cc6305-3dc3-5963-9880-cd5df1c48e9b with identifier: KL79607 to the API
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:40:57Z',
 'fuel_type': 'petrol',
 'id': 'c4cc6305-3dc3-5963-9880-cd5df1c48e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL79607',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 187897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-12-31',
 'seller_name': None,
 'title': 'Opel Astra 1.8 Bild Alternativ',
 'transmission': 'automatic',
 'trim': 'Bild Alternativ',
 'year': 2000}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.de] INFO: Saving data for KL79607: {'auction_closing_time': 1774716057.0, 'created_time': 1774608260.129506, 'last_price_update_time': 1774695866.746677}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL79607') HTTP/1.1" 204 0
2026-03-28 11:04:26 [auto1.de] INFO: Found listing with ID: VZ21746
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ21746%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [auto1.de] INFO: Scrape type for VZ21746: 2
2026-03-28 11:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c325213c-98d7-5b02-b0dd-1fcc571aa207 with identifier: VZ21746
2026-03-28 11:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c325213c-98d7-5b02-b0dd-1fcc571aa207 with scrape type 2
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c325213c-98d7-5b02-b0dd-1fcc571aa207 with scrape type 2
2026-03-28 11:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c325213c-98d7-5b02-b0dd-1fcc571aa207, identifier: VZ21746
2026-03-28 11:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c325213c-98d7-5b02-b0dd-1fcc571aa207 with identifier: VZ21746
2026-03-28 11:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c325213c-98d7-5b02-b0dd-1fcc571aa207 with identifier: VZ21746
2026-03-28 11:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c325213c-98d7-5b02-b0dd-1fcc571aa207 with identifier: VZ21746 to the API
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:12:51Z',
 'fuel_type': 'petrol',
 'id': 'c325213c-98d7-5b02-b0dd-1fcc571aa207',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ21746',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 135087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ21746%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.de] INFO: Saving data for VZ21746: {'auction_closing_time': 1774714371.0, 'created_time': 1774608318.811591, 'last_price_update_time': 1774695867.258814}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ21746') HTTP/1.1" 204 0
2026-03-28 11:04:27 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.de] INFO: Scrape type for DC30039: 2
2026-03-28 11:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039
2026-03-28 11:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb25c12a-97b7-5649-ac29-b32a9302172d with scrape type 2
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb25c12a-97b7-5649-ac29-b32a9302172d with scrape type 2
2026-03-28 11:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb25c12a-97b7-5649-ac29-b32a9302172d, identifier: DC30039
2026-03-28 11:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039
2026-03-28 11:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039
2026-03-28 11:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb25c12a-97b7-5649-ac29-b32a9302172d with identifier: DC30039 to the API
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:48:12Z',
 'fuel_type': 'petrol',
 'id': 'bb25c12a-97b7-5649-ac29-b32a9302172d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC30039',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 95401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-16',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.de] INFO: Saving data for DC30039: {'auction_closing_time': 1774716492.0, 'created_time': 1774608310.870023, 'last_price_update_time': 1774695867.685759}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC30039') HTTP/1.1" 204 0
2026-03-28 11:04:27 [auto1.de] INFO: Found listing with ID: PD92865
2026-03-28 11:04:27 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [auto1.de] INFO: Scrape type for CK72953: 2
2026-03-28 11:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953
2026-03-28 11:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f297e0e-9dbb-5272-a8f5-138589e5994b with scrape type 2
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f297e0e-9dbb-5272-a8f5-138589e5994b with scrape type 2
2026-03-28 11:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f297e0e-9dbb-5272-a8f5-138589e5994b, identifier: CK72953
2026-03-28 11:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953
2026-03-28 11:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953
2026-03-28 11:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f297e0e-9dbb-5272-a8f5-138589e5994b with identifier: CK72953 to the API
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:46:12Z',
 'fuel_type': 'petrol',
 'id': '2f297e0e-9dbb-5272-a8f5-138589e5994b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK72953',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 132539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-28',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Roadster',
 'transmission': 'automatic',
 'trim': 'Roadster',
 'year': 2008}
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-28 11:04:28 [auto1.de] INFO: Saving data for CK72953: {'auction_closing_time': 1774716372.0, 'created_time': 1774608259.768948, 'last_price_update_time': 1774695868.548978}
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK72953') HTTP/1.1" 204 0
2026-03-28 11:04:28 [auto1.de] INFO: Found listing with ID: TR81409
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81409%27 HTTP/1.1" 200 None
2026-03-28 11:04:28 [auto1.de] INFO: Scrape type for TR81409: 2
2026-03-28 11:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e57cc188-5e66-5ad7-b6ab-22277c30e36f with identifier: TR81409
2026-03-28 11:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e57cc188-5e66-5ad7-b6ab-22277c30e36f with scrape type 2
2026-03-28 11:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e57cc188-5e66-5ad7-b6ab-22277c30e36f with scrape type 2
2026-03-28 11:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e57cc188-5e66-5ad7-b6ab-22277c30e36f, identifier: TR81409
2026-03-28 11:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e57cc188-5e66-5ad7-b6ab-22277c30e36f with identifier: TR81409
2026-03-28 11:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e57cc188-5e66-5ad7-b6ab-22277c30e36f with identifier: TR81409
2026-03-28 11:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e57cc188-5e66-5ad7-b6ab-22277c30e36f with identifier: TR81409 to the API
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:18:46Z',
 'fuel_type': 'petrol',
 'id': 'e57cc188-5e66-5ad7-b6ab-22277c30e36f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR81409',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 179438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-01',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81409%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [auto1.de] INFO: Saving data for TR81409: {'auction_closing_time': 1774714726.0, 'created_time': 1774608258.294418, 'last_price_update_time': 1774695869.055762}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR81409') HTTP/1.1" 204 0
2026-03-28 11:04:29 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-28 11:04:29 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [auto1.de] INFO: Scrape type for GC04938: 2
2026-03-28 11:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938
2026-03-28 11:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d782adae-621d-5fef-a03f-a677a8b4cb84 with scrape type 2
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d782adae-621d-5fef-a03f-a677a8b4cb84 with scrape type 2
2026-03-28 11:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d782adae-621d-5fef-a03f-a677a8b4cb84, identifier: GC04938
2026-03-28 11:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938
2026-03-28 11:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938
2026-03-28 11:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d782adae-621d-5fef-a03f-a677a8b4cb84 with identifier: GC04938 to the API
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:47:07Z',
 'fuel_type': 'hybrid',
 'id': 'd782adae-621d-5fef-a03f-a677a8b4cb84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC04938',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Grandland X',
 'odometer': 45127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-26',
 'seller_name': None,
 'title': 'Opel Grandland X 1.6 Plug-in Hybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [auto1.de] INFO: Saving data for GC04938: {'auction_closing_time': 1774716427.0, 'created_time': 1774608324.393389, 'last_price_update_time': 1774695869.580249}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC04938') HTTP/1.1" 204 0
2026-03-28 11:04:29 [auto1.de] INFO: Found listing with ID: TF66313
2026-03-28 11:04:29 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [auto1.de] INFO: Scrape type for FV94610: 2
2026-03-28 11:04:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610
2026-03-28 11:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c019b7c-8204-52b8-bc97-8858d94ee509 with scrape type 2
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c019b7c-8204-52b8-bc97-8858d94ee509 with scrape type 2
2026-03-28 11:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c019b7c-8204-52b8-bc97-8858d94ee509, identifier: FV94610
2026-03-28 11:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610
2026-03-28 11:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610
2026-03-28 11:04:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c019b7c-8204-52b8-bc97-8858d94ee509 with identifier: FV94610 to the API
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:06:36Z',
 'fuel_type': 'petrol',
 'id': '2c019b7c-8204-52b8-bc97-8858d94ee509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV94610',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 70628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-19',
 'seller_name': None,
 'title': 'Ford Mondeo 1.5 EcoBoost Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2018}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.de] INFO: Saving data for FV94610: {'auction_closing_time': 1774713996.0, 'created_time': 1774608260.694232, 'last_price_update_time': 1774695870.049591}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV94610') HTTP/1.1" 204 0
2026-03-28 11:04:30 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.de] INFO: Scrape type for SM54936: 2
2026-03-28 11:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936
2026-03-28 11:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 659f7e39-f36d-592e-8b4e-18ed268e3373 with scrape type 2
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 659f7e39-f36d-592e-8b4e-18ed268e3373 with scrape type 2
2026-03-28 11:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 659f7e39-f36d-592e-8b4e-18ed268e3373, identifier: SM54936
2026-03-28 11:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936
2026-03-28 11:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936
2026-03-28 11:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 659f7e39-f36d-592e-8b4e-18ed268e3373 with identifier: SM54936 to the API
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:13:56Z',
 'fuel_type': 'diesel',
 'id': '659f7e39-f36d-592e-8b4e-18ed268e3373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM54936',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 330037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-28',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.9 TDI Comfortline Family',
 'transmission': 'manual',
 'trim': 'Comfortline Family',
 'year': 2003}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.de] INFO: Saving data for SM54936: {'auction_closing_time': 1774714436.0, 'created_time': 1774608259.002696, 'last_price_update_time': 1774695870.49283}
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM54936') HTTP/1.1" 204 0
2026-03-28 11:04:30 [auto1.de] INFO: Found listing with ID: CZ12085
2026-03-28 11:04:30 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [auto1.de] INFO: Scrape type for EA80690: 2
2026-03-28 11:04:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690
2026-03-28 11:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fb6605-c81f-5419-ba64-705d43223fb1 with scrape type 2
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4fb6605-c81f-5419-ba64-705d43223fb1 with scrape type 2
2026-03-28 11:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4fb6605-c81f-5419-ba64-705d43223fb1, identifier: EA80690
2026-03-28 11:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690
2026-03-28 11:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4fb6605-c81f-5419-ba64-705d43223fb1 with identifier: EA80690 to the API
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:11:24Z',
 'fuel_type': 'gas',
 'id': 'e4fb6605-c81f-5419-ba64-705d43223fb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA80690',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 42366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-13',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe LPG Extreme+',
 'transmission': 'manual',
 'trim': 'Extreme+',
 'year': 2023}
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-28 11:04:31 [auto1.de] INFO: Saving data for EA80690: {'auction_closing_time': 1774714284.0, 'created_time': 1774608267.898325, 'last_price_update_time': 1774695871.32967}
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA80690') HTTP/1.1" 204 0
2026-03-28 11:04:31 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-28 11:04:31 [auto1.de] INFO: Scrape type for RV26500: 2
2026-03-28 11:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500
2026-03-28 11:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3f8f6a2-a744-5295-96bd-003625d9e42d with scrape type 2
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3f8f6a2-a744-5295-96bd-003625d9e42d with scrape type 2
2026-03-28 11:04:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3f8f6a2-a744-5295-96bd-003625d9e42d, identifier: RV26500
2026-03-28 11:04:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500
2026-03-28 11:04:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500
2026-03-28 11:04:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3f8f6a2-a744-5295-96bd-003625d9e42d with identifier: RV26500 to the API
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:53Z',
 'fuel_type': 'diesel',
 'id': 'd3f8f6a2-a744-5295-96bd-003625d9e42d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV26500',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 66723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-25',
 'seller_name': None,
 'title': 'BMW 2er 218d Active Tourer Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2023}
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-28 11:04:31 [auto1.de] INFO: Saving data for RV26500: {'auction_closing_time': 1774715693.0, 'created_time': 1774608239.108031, 'last_price_update_time': 1774695871.887482}
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV26500') HTTP/1.1" 204 0
2026-03-28 11:04:31 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-28 11:04:31 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-28 11:04:31 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-28 11:04:31 [auto1.de] INFO: Scrape type for NG80154: 2
2026-03-28 11:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154
2026-03-28 11:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1cef325-c250-5e42-b342-b0497a60b29d with scrape type 2
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1cef325-c250-5e42-b342-b0497a60b29d with scrape type 2
2026-03-28 11:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1cef325-c250-5e42-b342-b0497a60b29d, identifier: NG80154
2026-03-28 11:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154
2026-03-28 11:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154
2026-03-28 11:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1cef325-c250-5e42-b342-b0497a60b29d with identifier: NG80154 to the API
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:05Z',
 'fuel_type': 'diesel',
 'id': 'a1cef325-c250-5e42-b342-b0497a60b29d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG80154',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 104165,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline Blue',
 'transmission': 'manual',
 'trim': 'Comfortline Blue',
 'year': 2014}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.de] INFO: Saving data for NG80154: {'auction_closing_time': 1774716605.0, 'created_time': 1774608254.86509, 'last_price_update_time': 1774695872.332153}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG80154') HTTP/1.1" 204 0
2026-03-28 11:04:32 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.de] INFO: Scrape type for WT06572: 2
2026-03-28 11:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572
2026-03-28 11:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde659ec-0fb7-5057-af9d-5776be325a82 with scrape type 2
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde659ec-0fb7-5057-af9d-5776be325a82 with scrape type 2
2026-03-28 11:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cde659ec-0fb7-5057-af9d-5776be325a82, identifier: WT06572
2026-03-28 11:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572
2026-03-28 11:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572
2026-03-28 11:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cde659ec-0fb7-5057-af9d-5776be325a82 with identifier: WT06572 to the API
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:14:50Z',
 'fuel_type': 'diesel',
 'id': 'cde659ec-0fb7-5057-af9d-5776be325a82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT06572',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 205087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-29',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2012}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.de] INFO: Saving data for WT06572: {'auction_closing_time': 1774714490.0, 'created_time': 1773230220.791237, 'last_price_update_time': 1774695872.851486}
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT06572') HTTP/1.1" 204 0
2026-03-28 11:04:32 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-28 11:04:32 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-28 11:04:32 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-28 11:04:32 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-28 11:04:32 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-28 11:04:32 [auto1.de] INFO: Found listing with ID: BX52233
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52233%27 HTTP/1.1" 200 None
2026-03-28 11:04:32 [auto1.de] INFO: Scrape type for BX52233: 2
2026-03-28 11:04:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63a13579-1684-5820-a755-629853006931 with identifier: BX52233
2026-03-28 11:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63a13579-1684-5820-a755-629853006931 with scrape type 2
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63a13579-1684-5820-a755-629853006931 with scrape type 2
2026-03-28 11:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63a13579-1684-5820-a755-629853006931, identifier: BX52233
2026-03-28 11:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63a13579-1684-5820-a755-629853006931 with identifier: BX52233
2026-03-28 11:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63a13579-1684-5820-a755-629853006931 with identifier: BX52233
2026-03-28 11:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63a13579-1684-5820-a755-629853006931 with identifier: BX52233 to the API
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:51:56Z',
 'fuel_type': 'diesel',
 'id': '63a13579-1684-5820-a755-629853006931',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX52233',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 224634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-12',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52233%27 HTTP/1.1" 200 None
2026-03-28 11:04:33 [auto1.de] INFO: Saving data for BX52233: {'auction_closing_time': 1774716716.0, 'created_time': 1774608244.713576, 'last_price_update_time': 1774695873.289193}
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX52233') HTTP/1.1" 204 0
2026-03-28 11:04:33 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:36 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 9702 | hits on page: 40
2026-03-28 11:04:36 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-28 11:04:36 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-28 11:04:36 [auto1.de] INFO: Scrape type for VH10355: 2
2026-03-28 11:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355
2026-03-28 11:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ff7c2b-7573-5561-bfb9-331d69ba5436 with scrape type 2
2026-03-28 11:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ff7c2b-7573-5561-bfb9-331d69ba5436 with scrape type 2
2026-03-28 11:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02ff7c2b-7573-5561-bfb9-331d69ba5436, identifier: VH10355
2026-03-28 11:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355
2026-03-28 11:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355
2026-03-28 11:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02ff7c2b-7573-5561-bfb9-331d69ba5436 with identifier: VH10355 to the API
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:50:18Z',
 'fuel_type': 'diesel',
 'id': '02ff7c2b-7573-5561-bfb9-331d69ba5436',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH10355',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 136448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-18',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2012}
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-28 11:04:37 [auto1.de] INFO: Saving data for VH10355: {'auction_closing_time': 1774716618.0, 'created_time': 1774607747.407943, 'last_price_update_time': 1774695877.086346}
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH10355') HTTP/1.1" 204 0
2026-03-28 11:04:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:37 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-28 11:04:37 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-28 11:04:37 [auto1.de] INFO: Found listing with ID: SV13508
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV13508%27 HTTP/1.1" 200 None
2026-03-28 11:04:37 [auto1.de] INFO: Scrape type for SV13508: 2
2026-03-28 11:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d453b8a3-059e-559b-b7ec-9fa99a243447 with identifier: SV13508
2026-03-28 11:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d453b8a3-059e-559b-b7ec-9fa99a243447 with scrape type 2
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d453b8a3-059e-559b-b7ec-9fa99a243447 with scrape type 2
2026-03-28 11:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d453b8a3-059e-559b-b7ec-9fa99a243447, identifier: SV13508
2026-03-28 11:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d453b8a3-059e-559b-b7ec-9fa99a243447 with identifier: SV13508
2026-03-28 11:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d453b8a3-059e-559b-b7ec-9fa99a243447 with identifier: SV13508
2026-03-28 11:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d453b8a3-059e-559b-b7ec-9fa99a243447 with identifier: SV13508 to the API
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:19:27Z',
 'fuel_type': 'petrol',
 'id': 'd453b8a3-059e-559b-b7ec-9fa99a243447',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV13508',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 127824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
 'transmission': 'manual',
 'trim': 'BlueEfficiency',
 'year': 2012}
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV13508%27 HTTP/1.1" 200 None
2026-03-28 11:04:37 [auto1.de] INFO: Saving data for SV13508: {'auction_closing_time': 1774714767.0, 'created_time': 1774608204.720214, 'last_price_update_time': 1774695877.495235}
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV13508') HTTP/1.1" 204 0
2026-03-28 11:04:37 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-28 11:04:37 [auto1.de] INFO: Scrape type for UP84428: 2
2026-03-28 11:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428
2026-03-28 11:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7887e963-f9ff-5927-94de-77b242b6e6b1 with scrape type 2
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7887e963-f9ff-5927-94de-77b242b6e6b1 with scrape type 2
2026-03-28 11:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7887e963-f9ff-5927-94de-77b242b6e6b1, identifier: UP84428
2026-03-28 11:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428
2026-03-28 11:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428
2026-03-28 11:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7887e963-f9ff-5927-94de-77b242b6e6b1 with identifier: UP84428 to the API
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:26:05Z',
 'fuel_type': 'diesel',
 'id': '7887e963-f9ff-5927-94de-77b242b6e6b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP84428',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 196034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTD BlueMotion Tech',
 'year': 2015}
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-28 11:04:37 [auto1.de] INFO: Saving data for UP84428: {'auction_closing_time': 1774715165.0, 'created_time': 1774002241.427034, 'last_price_update_time': 1774695877.954695}
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP84428') HTTP/1.1" 204 0
2026-03-28 11:04:37 [auto1.de] INFO: Found listing with ID: TE41931
2026-03-28 11:04:37 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-28 11:04:37 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-28 11:04:37 [auto1.de] INFO: Scrape type for BN83173: 2
2026-03-28 11:04:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173
2026-03-28 11:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with scrape type 2
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with scrape type 2
2026-03-28 11:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8, identifier: BN83173
2026-03-28 11:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173
2026-03-28 11:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173
2026-03-28 11:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8 with identifier: BN83173 to the API
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:43:55Z',
 'fuel_type': 'petrol',
 'id': 'f5e6ec6d-70fd-5b89-9f30-f131ccaeb9a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN83173',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 215615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-08',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Style Edition',
 'transmission': 'manual',
 'trim': 'Style Edition',
 'year': 2009}
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-28 11:04:38 [auto1.de] INFO: Saving data for BN83173: {'auction_closing_time': 1774716235.0, 'created_time': 1774608210.551016, 'last_price_update_time': 1774695878.41495}
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN83173') HTTP/1.1" 204 0
2026-03-28 11:04:38 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-28 11:04:38 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-28 11:04:38 [auto1.de] INFO: Scrape type for CS48399: 2
2026-03-28 11:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399
2026-03-28 11:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 507b67bd-ce04-58e7-80ac-0ce91872a85c with scrape type 2
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 507b67bd-ce04-58e7-80ac-0ce91872a85c with scrape type 2
2026-03-28 11:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 507b67bd-ce04-58e7-80ac-0ce91872a85c, identifier: CS48399
2026-03-28 11:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399
2026-03-28 11:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399
2026-03-28 11:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 507b67bd-ce04-58e7-80ac-0ce91872a85c with identifier: CS48399 to the API
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-28T16:55:13Z',
 'fuel_type': 'petrol',
 'id': '507b67bd-ce04-58e7-80ac-0ce91872a85c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS48399',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 69908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2022}
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-28 11:04:38 [auto1.de] INFO: Saving data for CS48399: {'auction_closing_time': 1774716913.0, 'created_time': 1773382503.097293, 'last_price_update_time': 1774695878.82199}
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS48399') HTTP/1.1" 204 0
2026-03-28 11:04:38 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-28 11:04:38 [auto1.de] INFO: Found listing with ID: VM88505
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88505%27 HTTP/1.1" 200 None
2026-03-28 11:04:38 [auto1.de] INFO: Scrape type for VM88505: 2
2026-03-28 11:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 593556e9-6717-55c2-b669-5dd70abc3ced with identifier: VM88505
2026-03-28 11:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 593556e9-6717-55c2-b669-5dd70abc3ced with scrape type 2
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 593556e9-6717-55c2-b669-5dd70abc3ced with scrape type 2
2026-03-28 11:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 593556e9-6717-55c2-b669-5dd70abc3ced, identifier: VM88505
2026-03-28 11:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 593556e9-6717-55c2-b669-5dd70abc3ced with identifier: VM88505
2026-03-28 11:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 593556e9-6717-55c2-b669-5dd70abc3ced with identifier: VM88505
2026-03-28 11:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 593556e9-6717-55c2-b669-5dd70abc3ced with identifier: VM88505 to the API
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:07:14Z',
 'fuel_type': 'petrol',
 'id': '593556e9-6717-55c2-b669-5dd70abc3ced',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM88505',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 89636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-19',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM88505%27 HTTP/1.1" 200 None
2026-03-28 11:04:39 [auto1.de] INFO: Saving data for VM88505: {'auction_closing_time': 1774714034.0, 'created_time': 1774608206.372746, 'last_price_update_time': 1774695879.32515}
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM88505') HTTP/1.1" 204 0
2026-03-28 11:04:39 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-28 11:04:39 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-28 11:04:39 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-28 11:04:39 [auto1.de] INFO: Scrape type for RP72323: 2
2026-03-28 11:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323
2026-03-28 11:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a6804a-4c22-514c-9e80-c2d2723e112b with scrape type 2
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a6804a-4c22-514c-9e80-c2d2723e112b with scrape type 2
2026-03-28 11:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a6804a-4c22-514c-9e80-c2d2723e112b, identifier: RP72323
2026-03-28 11:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323
2026-03-28 11:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323
2026-03-28 11:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a6804a-4c22-514c-9e80-c2d2723e112b with identifier: RP72323 to the API
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:41:02Z',
 'fuel_type': 'diesel',
 'id': 'd2a6804a-4c22-514c-9e80-c2d2723e112b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP72323',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 217250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive Advantage',
 'transmission': 'automatic',
 'trim': 'xDrive Advantage',
 'year': 2015}
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-28 11:04:39 [auto1.de] INFO: Saving data for RP72323: {'auction_closing_time': 1774716062.0, 'created_time': 1773401592.100677, 'last_price_update_time': 1774695879.73906}
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP72323') HTTP/1.1" 204 0
2026-03-28 11:04:39 [auto1.de] INFO: Found listing with ID: LA39027
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA39027%27 HTTP/1.1" 200 None
2026-03-28 11:04:39 [auto1.de] INFO: Scrape type for LA39027: 2
2026-03-28 11:04:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with identifier: LA39027
2026-03-28 11:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with scrape type 2
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with scrape type 2
2026-03-28 11:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c, identifier: LA39027
2026-03-28 11:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with identifier: LA39027
2026-03-28 11:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with identifier: LA39027
2026-03-28 11:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8c33c38-7c3a-5b4d-a887-6120b12f3f0c with identifier: LA39027 to the API
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:02:52Z',
 'fuel_type': 'diesel',
 'id': 'e8c33c38-7c3a-5b4d-a887-6120b12f3f0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA39027',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 286842,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-30',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2004}
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA39027%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [auto1.de] INFO: Saving data for LA39027: {'auction_closing_time': 1774713772.0, 'created_time': 1774608348.12103, 'last_price_update_time': 1774695880.155097}
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA39027') HTTP/1.1" 204 0
2026-03-28 11:04:40 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [auto1.de] INFO: Scrape type for MW80784: 2
2026-03-28 11:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784
2026-03-28 11:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2653b174-06e5-50de-887b-c45ebcc68d2b with scrape type 2
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2653b174-06e5-50de-887b-c45ebcc68d2b with scrape type 2
2026-03-28 11:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2653b174-06e5-50de-887b-c45ebcc68d2b, identifier: MW80784
2026-03-28 11:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784
2026-03-28 11:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784
2026-03-28 11:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2653b174-06e5-50de-887b-c45ebcc68d2b with identifier: MW80784 to the API
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:28:54Z',
 'fuel_type': 'diesel',
 'id': '2653b174-06e5-50de-887b-c45ebcc68d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW80784',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 121034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-25',
 'seller_name': None,
 'title': 'Opel Combo 1.6 CDTI Kasten L1H1 2,4t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,4t',
 'year': 2016}
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [auto1.de] INFO: Saving data for MW80784: {'auction_closing_time': 1774715334.0, 'created_time': 1774608363.623562, 'last_price_update_time': 1774695880.606868}
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW80784') HTTP/1.1" 204 0
2026-03-28 11:04:40 [auto1.de] INFO: Found listing with ID: EM63340
2026-03-28 11:04:40 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-28 11:04:40 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [auto1.de] INFO: Scrape type for HB95489: 2
2026-03-28 11:04:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489
2026-03-28 11:04:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e620f3e6-49a7-5678-840b-c8020f1d696c with scrape type 2
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e620f3e6-49a7-5678-840b-c8020f1d696c with scrape type 2
2026-03-28 11:04:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e620f3e6-49a7-5678-840b-c8020f1d696c, identifier: HB95489
2026-03-28 11:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489
2026-03-28 11:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489
2026-03-28 11:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e620f3e6-49a7-5678-840b-c8020f1d696c with identifier: HB95489 to the API
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:45:51Z',
 'fuel_type': 'petrol',
 'id': 'e620f3e6-49a7-5678-840b-c8020f1d696c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB95489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 19702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2025}
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [auto1.de] INFO: Saving data for HB95489: {'auction_closing_time': 1774716351.0, 'created_time': 1774608350.293553, 'last_price_update_time': 1774695881.030387}
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB95489') HTTP/1.1" 204 0
2026-03-28 11:04:41 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [auto1.de] INFO: Scrape type for DZ70756: 2
2026-03-28 11:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756
2026-03-28 11:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b20238c3-58c1-5329-ad11-23c265dac4e5 with scrape type 2
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b20238c3-58c1-5329-ad11-23c265dac4e5 with scrape type 2
2026-03-28 11:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b20238c3-58c1-5329-ad11-23c265dac4e5, identifier: DZ70756
2026-03-28 11:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756
2026-03-28 11:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756
2026-03-28 11:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b20238c3-58c1-5329-ad11-23c265dac4e5 with identifier: DZ70756 to the API
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:36:58Z',
 'fuel_type': 'diesel',
 'id': 'b20238c3-58c1-5329-ad11-23c265dac4e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ70756',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 182385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-28',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI Tour',
 'transmission': 'automatic',
 'trim': 'Tour',
 'year': 2007}
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [auto1.de] INFO: Saving data for DZ70756: {'auction_closing_time': 1774715818.0, 'created_time': 1773131948.902892, 'last_price_update_time': 1774695881.464926}
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ70756') HTTP/1.1" 204 0
2026-03-28 11:04:41 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-28 11:04:41 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [auto1.de] INFO: Scrape type for TG96584: 2
2026-03-28 11:04:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584
2026-03-28 11:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with scrape type 2
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with scrape type 2
2026-03-28 11:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4, identifier: TG96584
2026-03-28 11:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584
2026-03-28 11:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584
2026-03-28 11:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4 with identifier: TG96584 to the API
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:59:51Z',
 'fuel_type': 'diesel',
 'id': '7d1e7c74-e477-5cbe-b9c3-77e3570cc0d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG96584',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 82638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-09',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 160 CDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [auto1.de] INFO: Saving data for TG96584: {'auction_closing_time': 1774717191.0, 'created_time': 1774608351.072797, 'last_price_update_time': 1774695881.975954}
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG96584') HTTP/1.1" 204 0
2026-03-28 11:04:41 [auto1.de] INFO: Found listing with ID: KY59799
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY59799%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [auto1.de] INFO: Scrape type for KY59799: 2
2026-03-28 11:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a27e591-12a2-519c-afee-8da7428cc02c with identifier: KY59799
2026-03-28 11:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a27e591-12a2-519c-afee-8da7428cc02c with scrape type 2
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a27e591-12a2-519c-afee-8da7428cc02c with scrape type 2
2026-03-28 11:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a27e591-12a2-519c-afee-8da7428cc02c, identifier: KY59799
2026-03-28 11:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a27e591-12a2-519c-afee-8da7428cc02c with identifier: KY59799
2026-03-28 11:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a27e591-12a2-519c-afee-8da7428cc02c with identifier: KY59799
2026-03-28 11:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a27e591-12a2-519c-afee-8da7428cc02c with identifier: KY59799 to the API
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:11:28Z',
 'fuel_type': 'petrol',
 'id': '9a27e591-12a2-519c-afee-8da7428cc02c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY59799',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 28914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-15',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2011}
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY59799%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [auto1.de] INFO: Saving data for KY59799: {'auction_closing_time': 1774714288.0, 'created_time': 1774608345.999984, 'last_price_update_time': 1774695882.399289}
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY59799') HTTP/1.1" 204 0
2026-03-28 11:04:42 [auto1.de] INFO: Found listing with ID: NG10221
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG10221%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [auto1.de] INFO: Scrape type for NG10221: 2
2026-03-28 11:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221
2026-03-28 11:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2717c145-1d62-520f-9847-00fdf35aaef0 with scrape type 2
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2717c145-1d62-520f-9847-00fdf35aaef0 with scrape type 2
2026-03-28 11:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2717c145-1d62-520f-9847-00fdf35aaef0, identifier: NG10221
2026-03-28 11:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221
2026-03-28 11:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221
2026-03-28 11:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2717c145-1d62-520f-9847-00fdf35aaef0 with identifier: NG10221 to the API
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:43:29Z',
 'fuel_type': 'diesel',
 'id': '2717c145-1d62-520f-9847-00fdf35aaef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG10221',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 145040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-22',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG10221%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [auto1.de] INFO: Saving data for NG10221: {'auction_closing_time': 1774716209.0, 'created_time': 1774608333.001277, 'last_price_update_time': 1774695882.825493}
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG10221') HTTP/1.1" 204 0
2026-03-28 11:04:42 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-28 11:04:42 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-28 11:04:42 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-28 11:04:42 [auto1.de] INFO: Found listing with ID: HK36179
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK36179%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [auto1.de] INFO: Scrape type for HK36179: 2
2026-03-28 11:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with identifier: HK36179
2026-03-28 11:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with scrape type 2
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with scrape type 2
2026-03-28 11:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8705a19a-76d9-5f20-b84b-fd75a0cecf27, identifier: HK36179
2026-03-28 11:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with identifier: HK36179
2026-03-28 11:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with identifier: HK36179
2026-03-28 11:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8705a19a-76d9-5f20-b84b-fd75a0cecf27 with identifier: HK36179 to the API
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-28T16:36:48Z',
 'fuel_type': 'petrol',
 'id': '8705a19a-76d9-5f20-b84b-fd75a0cecf27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK36179',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 37244,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.5 TSI Maxi',
 'transmission': 'manual',
 'trim': 'Maxi',
 'year': 2022}
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK36179%27 HTTP/1.1" 200 None
2026-03-28 11:04:43 [auto1.de] INFO: Saving data for HK36179: {'auction_closing_time': 1774715808.0, 'created_time': 1774608333.531908, 'last_price_update_time': 1774695883.237842}
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK36179') HTTP/1.1" 204 0
2026-03-28 11:04:43 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-28 11:04:43 [auto1.de] INFO: Found listing with ID: DF69059
2026-03-28 11:04:43 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-28 11:04:43 [auto1.de] INFO: Scrape type for HV45616: 2
2026-03-28 11:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616
2026-03-28 11:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db2540f8-6be7-52b5-8977-7c8213769550 with scrape type 2
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db2540f8-6be7-52b5-8977-7c8213769550 with scrape type 2
2026-03-28 11:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db2540f8-6be7-52b5-8977-7c8213769550, identifier: HV45616
2026-03-28 11:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616
2026-03-28 11:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616
2026-03-28 11:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db2540f8-6be7-52b5-8977-7c8213769550 with identifier: HV45616 to the API
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:26:44Z',
 'fuel_type': 'petrol',
 'id': 'db2540f8-6be7-52b5-8977-7c8213769550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV45616',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 220217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-10',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2005}
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-28 11:04:43 [auto1.de] INFO: Saving data for HV45616: {'auction_closing_time': 1774715204.0, 'created_time': 1774608303.153247, 'last_price_update_time': 1774695883.660572}
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV45616') HTTP/1.1" 204 0
2026-03-28 11:04:43 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-28 11:04:43 [auto1.de] INFO: Scrape type for XT42199: 2
2026-03-28 11:04:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199
2026-03-28 11:04:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bfccc22-160e-5798-9837-1f036baa35e0 with scrape type 2
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bfccc22-160e-5798-9837-1f036baa35e0 with scrape type 2
2026-03-28 11:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bfccc22-160e-5798-9837-1f036baa35e0, identifier: XT42199
2026-03-28 11:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199
2026-03-28 11:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199
2026-03-28 11:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bfccc22-160e-5798-9837-1f036baa35e0 with identifier: XT42199 to the API
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:29:55Z',
 'fuel_type': 'diesel',
 'id': '7bfccc22-160e-5798-9837-1f036baa35e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT42199',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 149885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-18',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'automatic',
 'trim': 'Sports-Line AWD',
 'year': 2015}
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-28 11:04:44 [auto1.de] INFO: Saving data for XT42199: {'auction_closing_time': 1774715395.0, 'created_time': 1774608213.149039, 'last_price_update_time': 1774695884.209851}
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT42199') HTTP/1.1" 204 0
2026-03-28 11:04:44 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-28 11:04:44 [auto1.de] INFO: Found listing with ID: ZK69536
2026-03-28 11:04:44 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-28 11:04:44 [auto1.de] INFO: Scrape type for AW78451: 2
2026-03-28 11:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451
2026-03-28 11:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c77a6e79-b54a-5afc-ab84-67ab178c8d85 with scrape type 2
2026-03-28 11:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c77a6e79-b54a-5afc-ab84-67ab178c8d85 with scrape type 2
2026-03-28 11:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c77a6e79-b54a-5afc-ab84-67ab178c8d85, identifier: AW78451
2026-03-28 11:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451
2026-03-28 11:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451
2026-03-28 11:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c77a6e79-b54a-5afc-ab84-67ab178c8d85 with identifier: AW78451 to the API
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:26:32Z',
 'fuel_type': 'diesel',
 'id': 'c77a6e79-b54a-5afc-ab84-67ab178c8d85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW78451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 181887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2016}
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-28 11:04:44 [auto1.de] INFO: Saving data for AW78451: {'auction_closing_time': 1774715192.0, 'created_time': 1773917427.303254, 'last_price_update_time': 1774695884.64131}
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW78451') HTTP/1.1" 204 0
2026-03-28 11:04:44 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-28 11:04:44 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-28 11:04:44 [auto1.de] INFO: Scrape type for SV60739: 2
2026-03-28 11:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739
2026-03-28 11:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with scrape type 2
2026-03-28 11:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with scrape type 2
2026-03-28 11:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bec28c5-1c2b-5132-b3c4-e1281ca87221, identifier: SV60739
2026-03-28 11:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739
2026-03-28 11:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739
2026-03-28 11:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bec28c5-1c2b-5132-b3c4-e1281ca87221 with identifier: SV60739 to the API
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:01:23Z',
 'fuel_type': 'diesel',
 'id': '4bec28c5-1c2b-5132-b3c4-e1281ca87221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV60739',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 224340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-05',
 'seller_name': None,
 'title': 'Volvo V60 1.6 D Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2012}
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [auto1.de] INFO: Saving data for SV60739: {'auction_closing_time': 1774713683.0, 'created_time': 1774608203.342127, 'last_price_update_time': 1774695885.060182}
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV60739') HTTP/1.1" 204 0
2026-03-28 11:04:45 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 9702 | hits on page: 40
2026-03-28 11:04:45 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ69357%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [auto1.de] INFO: Scrape type for SZ69357: 2
2026-03-28 11:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357
2026-03-28 11:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea77ddc3-e24b-5693-bbcc-61718932a5cc with scrape type 2
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea77ddc3-e24b-5693-bbcc-61718932a5cc with scrape type 2
2026-03-28 11:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea77ddc3-e24b-5693-bbcc-61718932a5cc, identifier: SZ69357
2026-03-28 11:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357
2026-03-28 11:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357
2026-03-28 11:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357 to the API
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:43:23Z',
 'fuel_type': 'petrol',
 'id': 'ea77ddc3-e24b-5693-bbcc-61718932a5cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ69357',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 45548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-21',
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech So Chic',
 'transmission': 'manual',
 'trim': 'So Chic',
 'year': 2020}
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ69357%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [auto1.de] INFO: Saving data for SZ69357: {'auction_closing_time': 1774716203.0, 'created_time': 1774607749.196827, 'last_price_update_time': 1774695885.500842}
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ69357') HTTP/1.1" 204 0
2026-03-28 11:04:45 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [auto1.de] INFO: Scrape type for YU03537: 2
2026-03-28 11:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537
2026-03-28 11:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with scrape type 2
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with scrape type 2
2026-03-28 11:04:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 747ae73a-61b7-58de-b89c-2d8d5ea910c3, identifier: YU03537
2026-03-28 11:04:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537
2026-03-28 11:04:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537
2026-03-28 11:04:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 747ae73a-61b7-58de-b89c-2d8d5ea910c3 with identifier: YU03537 to the API
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:39:09Z',
 'fuel_type': 'hybrid',
 'id': '747ae73a-61b7-58de-b89c-2d8d5ea910c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU03537',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 99222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-16',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2022}
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [auto1.de] INFO: Saving data for YU03537: {'auction_closing_time': 1774715949.0, 'created_time': 1774607779.146964, 'last_price_update_time': 1774695885.907036}
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU03537') HTTP/1.1" 204 0
2026-03-28 11:04:45 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [auto1.de] INFO: Scrape type for EN83370: 2
2026-03-28 11:04:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370
2026-03-28 11:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c74ef32a-1a46-5836-9cd9-536cb191af33 with scrape type 2
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c74ef32a-1a46-5836-9cd9-536cb191af33 with scrape type 2
2026-03-28 11:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c74ef32a-1a46-5836-9cd9-536cb191af33, identifier: EN83370
2026-03-28 11:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370
2026-03-28 11:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370
2026-03-28 11:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c74ef32a-1a46-5836-9cd9-536cb191af33 with identifier: EN83370 to the API
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:42:02Z',
 'fuel_type': 'petrol',
 'id': 'c74ef32a-1a46-5836-9cd9-536cb191af33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN83370',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 114215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-07',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-28 11:04:46 [auto1.de] INFO: Saving data for EN83370: {'auction_closing_time': 1774716122.0, 'created_time': 1774607748.40188, 'last_price_update_time': 1774695886.39521}
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN83370') HTTP/1.1" 204 0
2026-03-28 11:04:46 [auto1.de] INFO: Found listing with ID: NG01563
2026-03-28 11:04:46 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-28 11:04:46 [auto1.de] INFO: Scrape type for NB27251: 2
2026-03-28 11:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251
2026-03-28 11:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e49f55e-218f-56a0-bab7-cb2796f14128 with scrape type 2
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e49f55e-218f-56a0-bab7-cb2796f14128 with scrape type 2
2026-03-28 11:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e49f55e-218f-56a0-bab7-cb2796f14128, identifier: NB27251
2026-03-28 11:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251
2026-03-28 11:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251
2026-03-28 11:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e49f55e-218f-56a0-bab7-cb2796f14128 with identifier: NB27251 to the API
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 398,
 'expiration_date': '2026-03-28T16:33:48Z',
 'fuel_type': 'petrol',
 'id': '3e49f55e-218f-56a0-bab7-cb2796f14128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB27251',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 18642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-22',
 'seller_name': None,
 'title': 'BMW X3 M50 Mild-Hybrid M Performance xDrive',
 'transmission': 'automatic',
 'trim': 'M Performance xDrive',
 'year': 2025}
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-28 11:04:46 [auto1.de] INFO: Saving data for NB27251: {'auction_closing_time': 1774715628.0, 'created_time': 1773917434.791458, 'last_price_update_time': 1774695886.831471}
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB27251') HTTP/1.1" 204 0
2026-03-28 11:04:46 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-28 11:04:46 [auto1.de] INFO: Scrape type for YP91741: 2
2026-03-28 11:04:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741
2026-03-28 11:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with scrape type 2
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with scrape type 2
2026-03-28 11:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef9df5d1-7f25-529c-a24c-f92f72dae2c3, identifier: YP91741
2026-03-28 11:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741
2026-03-28 11:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741
2026-03-28 11:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef9df5d1-7f25-529c-a24c-f92f72dae2c3 with identifier: YP91741 to the API
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:48:47Z',
 'fuel_type': 'petrol',
 'id': 'ef9df5d1-7f25-529c-a24c-f92f72dae2c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP91741',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 82020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-14',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-28 11:04:47 [auto1.de] INFO: Saving data for YP91741: {'auction_closing_time': 1774716527.0, 'created_time': 1774608236.491665, 'last_price_update_time': 1774695887.354519}
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP91741') HTTP/1.1" 204 0
2026-03-28 11:04:47 [auto1.de] INFO: Found listing with ID: XX11179
2026-03-28 11:04:47 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-28 11:04:47 [auto1.de] INFO: Scrape type for LS95970: 2
2026-03-28 11:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970
2026-03-28 11:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba with scrape type 2
2026-03-28 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a95b3bf0-d1d9-5693-a56a-2595fc3236ba with scrape type 2
2026-03-28 11:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a95b3bf0-d1d9-5693-a56a-2595fc3236ba, identifier: LS95970
2026-03-28 11:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970
2026-03-28 11:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970
2026-03-28 11:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a95b3bf0-d1d9-5693-a56a-2595fc3236ba with identifier: LS95970 to the API
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:36Z',
 'fuel_type': 'diesel',
 'id': 'a95b3bf0-d1d9-5693-a56a-2595fc3236ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS95970',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 251863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-29',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 115 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2005}
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-28 11:04:47 [auto1.de] INFO: Saving data for LS95970: {'auction_closing_time': 1774717116.0, 'created_time': 1774608299.152545, 'last_price_update_time': 1774695887.753189}
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS95970') HTTP/1.1" 204 0
2026-03-28 11:04:47 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-28 11:04:47 [auto1.de] INFO: Scrape type for ML63417: 2
2026-03-28 11:04:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417
2026-03-28 11:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with scrape type 2
2026-03-28 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with scrape type 2
2026-03-28 11:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8c48f9e-1c72-5d99-bca9-2c24a87ff617, identifier: ML63417
2026-03-28 11:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417
2026-03-28 11:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417
2026-03-28 11:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8c48f9e-1c72-5d99-bca9-2c24a87ff617 with identifier: ML63417 to the API
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:59:19Z',
 'fuel_type': 'diesel',
 'id': 'c8c48f9e-1c72-5d99-bca9-2c24a87ff617',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML63417',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 183024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI kompakt BlueEfficiency Trend Edition',
 'transmission': 'automatic',
 'trim': 'kompakt BlueEfficiency Trend Edition',
 'year': 2011}
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-28 11:04:48 [auto1.de] INFO: Saving data for ML63417: {'auction_closing_time': 1774717159.0, 'created_time': 1774607772.857587, 'last_price_update_time': 1774695888.174251}
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML63417') HTTP/1.1" 204 0
2026-03-28 11:04:48 [auto1.de] INFO: Found listing with ID: HK63697
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK63697%27 HTTP/1.1" 200 None
2026-03-28 11:04:48 [auto1.de] INFO: Scrape type for HK63697: 2
2026-03-28 11:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697
2026-03-28 11:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with scrape type 2
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with scrape type 2
2026-03-28 11:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6f0a743-ec6e-5e13-8d60-b5021a1389c3, identifier: HK63697
2026-03-28 11:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697
2026-03-28 11:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697
2026-03-28 11:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6f0a743-ec6e-5e13-8d60-b5021a1389c3 with identifier: HK63697 to the API
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 462,
 'expiration_date': '2026-03-28T16:31:17Z',
 'fuel_type': 'hybrid',
 'id': 'd6f0a743-ec6e-5e13-8d60-b5021a1389c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK63697',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 23182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-23',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 TSI eHybrid R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2024}
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK63697%27 HTTP/1.1" 200 None
2026-03-28 11:04:48 [auto1.de] INFO: Saving data for HK63697: {'auction_closing_time': 1774715477.0, 'created_time': 1774608304.869078, 'last_price_update_time': 1774695888.606773}
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK63697') HTTP/1.1" 204 0
2026-03-28 11:04:48 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-28 11:04:48 [auto1.de] INFO: Scrape type for ZB26924: 2
2026-03-28 11:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924
2026-03-28 11:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 592720dc-d255-5ef9-9ad6-0d05d74c0385 with scrape type 2
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 592720dc-d255-5ef9-9ad6-0d05d74c0385 with scrape type 2
2026-03-28 11:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 592720dc-d255-5ef9-9ad6-0d05d74c0385, identifier: ZB26924
2026-03-28 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924
2026-03-28 11:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924
2026-03-28 11:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 592720dc-d255-5ef9-9ad6-0d05d74c0385 with identifier: ZB26924 to the API
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:19:59Z',
 'fuel_type': 'diesel',
 'id': '592720dc-d255-5ef9-9ad6-0d05d74c0385',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB26924',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 184222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-28 11:04:49 [auto1.de] INFO: Saving data for ZB26924: {'auction_closing_time': 1774714799.0, 'created_time': 1773304552.381397, 'last_price_update_time': 1774695889.023956}
2026-03-28 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB26924') HTTP/1.1" 204 0
2026-03-28 11:04:49 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-28 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-28 11:04:49 [auto1.de] INFO: Scrape type for AN46464: 2
2026-03-28 11:04:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464
2026-03-28 11:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6351d24-e791-578a-85a9-ad351bd10293 with scrape type 2
2026-03-28 11:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6351d24-e791-578a-85a9-ad351bd10293 with scrape type 2
2026-03-28 11:04:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6351d24-e791-578a-85a9-ad351bd10293, identifier: AN46464
2026-03-28 11:04:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464
2026-03-28 11:04:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464
2026-03-28 11:04:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6351d24-e791-578a-85a9-ad351bd10293 with identifier: AN46464 to the API
2026-03-28 11:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:42:46Z',
 'fuel_type': 'diesel',
 'id': 'a6351d24-e791-578a-85a9-ad351bd10293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN46464',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 171218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-12',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-28 11:04:50 [auto1.de] INFO: Saving data for AN46464: {'auction_closing_time': 1774716166.0, 'created_time': 1774607783.191696, 'last_price_update_time': 1774695890.102849}
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN46464') HTTP/1.1" 204 0
2026-03-28 11:04:50 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-28 11:04:50 [auto1.de] INFO: Found listing with ID: RM96597
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM96597%27 HTTP/1.1" 200 None
2026-03-28 11:04:50 [auto1.de] INFO: Scrape type for RM96597: 2
2026-03-28 11:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 432be146-7242-5d8d-8812-054af96c35dc with identifier: RM96597
2026-03-28 11:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 432be146-7242-5d8d-8812-054af96c35dc with scrape type 2
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 432be146-7242-5d8d-8812-054af96c35dc with scrape type 2
2026-03-28 11:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 432be146-7242-5d8d-8812-054af96c35dc, identifier: RM96597
2026-03-28 11:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 432be146-7242-5d8d-8812-054af96c35dc with identifier: RM96597
2026-03-28 11:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 432be146-7242-5d8d-8812-054af96c35dc with identifier: RM96597
2026-03-28 11:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 432be146-7242-5d8d-8812-054af96c35dc with identifier: RM96597 to the API
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:07Z',
 'fuel_type': 'petrol',
 'id': '432be146-7242-5d8d-8812-054af96c35dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM96597',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 211509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-22',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Innovation Start/Stop',
 'transmission': 'automatic',
 'trim': 'Innovation Start/Stop',
 'year': 2017}
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM96597%27 HTTP/1.1" 200 None
2026-03-28 11:04:50 [auto1.de] INFO: Saving data for RM96597: {'auction_closing_time': 1774714387.0, 'created_time': 1774608275.527707, 'last_price_update_time': 1774695890.516318}
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM96597') HTTP/1.1" 204 0
2026-03-28 11:04:50 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 9702 | hits on page: 40
2026-03-28 11:04:50 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-28 11:04:50 [auto1.de] INFO: Found listing with ID: LW83066
2026-03-28 11:04:50 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-28 11:04:50 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-28 11:04:50 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-28 11:04:50 [auto1.de] INFO: Scrape type for LN38152: 2
2026-03-28 11:04:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152
2026-03-28 11:04:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with scrape type 2
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with scrape type 2
2026-03-28 11:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7, identifier: LN38152
2026-03-28 11:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152
2026-03-28 11:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152
2026-03-28 11:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7 with identifier: LN38152 to the API
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:22:36Z',
 'fuel_type': 'petrol',
 'id': 'c299f5e9-01b5-53f2-bbf0-e2f5ba7835d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN38152',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 110118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-28',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-28 11:04:50 [auto1.de] INFO: Saving data for LN38152: {'auction_closing_time': 1774714956.0, 'created_time': 1773229484.027555, 'last_price_update_time': 1774695890.96696}
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN38152') HTTP/1.1" 204 0
2026-03-28 11:04:51 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-28 11:04:51 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [auto1.de] INFO: Scrape type for JJ72083: 2
2026-03-28 11:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083
2026-03-28 11:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34afeef-5117-56ec-9dae-070513927659 with scrape type 2
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c34afeef-5117-56ec-9dae-070513927659 with scrape type 2
2026-03-28 11:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c34afeef-5117-56ec-9dae-070513927659, identifier: JJ72083
2026-03-28 11:04:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:51 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-28 11:04:51 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-28 11:04:51 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [auto1.de] INFO: Scrape type for ZE90376: 2
2026-03-28 11:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376
2026-03-28 11:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with scrape type 2
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with scrape type 2
2026-03-28 11:04:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aac36263-1b24-5c0a-8dc9-5ff1b48eef21, identifier: ZE90376
2026-03-28 11:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083
2026-03-28 11:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083
2026-03-28 11:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c34afeef-5117-56ec-9dae-070513927659 with identifier: JJ72083 to the API
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:21:30Z',
 'fuel_type': 'diesel',
 'id': 'c34afeef-5117-56ec-9dae-070513927659',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ72083',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 154163,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [auto1.de] INFO: Saving data for JJ72083: {'auction_closing_time': 1774714890.0, 'created_time': 1774350245.897141, 'last_price_update_time': 1774695891.629895}
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ72083') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376
2026-03-28 11:04:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376
2026-03-28 11:04:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aac36263-1b24-5c0a-8dc9-5ff1b48eef21 with identifier: ZE90376 to the API
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:03Z',
 'fuel_type': 'petrol',
 'id': 'aac36263-1b24-5c0a-8dc9-5ff1b48eef21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE90376',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 13000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-13',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TSI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2024}
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [auto1.de] INFO: Saving data for ZE90376: {'auction_closing_time': 1774716723.0, 'created_time': 1772728480.041797, 'last_price_update_time': 1774695891.957917}
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE90376') HTTP/1.1" 204 0
2026-03-28 11:04:51 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [auto1.de] INFO: Scrape type for GB33155: 2
2026-03-28 11:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155
2026-03-28 11:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4513884a-a292-5c24-86ce-a6b7efa1127a with scrape type 2
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4513884a-a292-5c24-86ce-a6b7efa1127a with scrape type 2
2026-03-28 11:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4513884a-a292-5c24-86ce-a6b7efa1127a, identifier: GB33155
2026-03-28 11:04:52 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [auto1.de] INFO: Scrape type for TS36559: 2
2026-03-28 11:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559
2026-03-28 11:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30687c1f-da00-51ca-a284-0ac97a3dd676 with scrape type 2
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30687c1f-da00-51ca-a284-0ac97a3dd676 with scrape type 2
2026-03-28 11:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30687c1f-da00-51ca-a284-0ac97a3dd676, identifier: TS36559
2026-03-28 11:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155
2026-03-28 11:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155
2026-03-28 11:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4513884a-a292-5c24-86ce-a6b7efa1127a with identifier: GB33155 to the API
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:47:25Z',
 'fuel_type': 'diesel',
 'id': '4513884a-a292-5c24-86ce-a6b7efa1127a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB33155',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 141542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-08',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2016}
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [auto1.de] INFO: Saving data for GB33155: {'auction_closing_time': 1774716445.0, 'created_time': 1774607768.059367, 'last_price_update_time': 1774695892.509657}
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB33155') HTTP/1.1" 204 0
2026-03-28 11:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559
2026-03-28 11:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559
2026-03-28 11:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30687c1f-da00-51ca-a284-0ac97a3dd676 with identifier: TS36559 to the API
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:16:32Z',
 'fuel_type': 'petrol',
 'id': '30687c1f-da00-51ca-a284-0ac97a3dd676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS36559',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 149965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-06',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [auto1.de] INFO: Saving data for TS36559: {'auction_closing_time': 1774714592.0, 'created_time': 1774608306.725129, 'last_price_update_time': 1774695892.830966}
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS36559') HTTP/1.1" 204 0
2026-03-28 11:04:52 [auto1.de] INFO: Found listing with ID: FR69790
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69790%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [auto1.de] INFO: Scrape type for FR69790: 2
2026-03-28 11:04:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb5db8d2-4364-5068-ad37-0111f938b3a7 with identifier: FR69790
2026-03-28 11:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb5db8d2-4364-5068-ad37-0111f938b3a7 with scrape type 2
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb5db8d2-4364-5068-ad37-0111f938b3a7 with scrape type 2
2026-03-28 11:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb5db8d2-4364-5068-ad37-0111f938b3a7, identifier: FR69790
2026-03-28 11:04:52 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [auto1.de] INFO: Scrape type for EU51889: 2
2026-03-28 11:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889
2026-03-28 11:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60053297-7423-53c8-8613-9e1c2f5def8c with scrape type 2
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60053297-7423-53c8-8613-9e1c2f5def8c with scrape type 2
2026-03-28 11:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60053297-7423-53c8-8613-9e1c2f5def8c, identifier: EU51889
2026-03-28 11:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb5db8d2-4364-5068-ad37-0111f938b3a7 with identifier: FR69790
2026-03-28 11:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb5db8d2-4364-5068-ad37-0111f938b3a7 with identifier: FR69790
2026-03-28 11:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb5db8d2-4364-5068-ad37-0111f938b3a7 with identifier: FR69790 to the API
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:13:47Z',
 'fuel_type': 'petrol',
 'id': 'cb5db8d2-4364-5068-ad37-0111f938b3a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR69790',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 72008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-04',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Mild-Hybrid Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2021}
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69790%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [auto1.de] INFO: Saving data for FR69790: {'auction_closing_time': 1774714427.0, 'created_time': 1774608233.940728, 'last_price_update_time': 1774695893.442082}
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR69790') HTTP/1.1" 204 0
2026-03-28 11:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889
2026-03-28 11:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889
2026-03-28 11:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60053297-7423-53c8-8613-9e1c2f5def8c with identifier: EU51889 to the API
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:39:06Z',
 'fuel_type': 'petrol',
 'id': '60053297-7423-53c8-8613-9e1c2f5def8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU51889',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 205415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-13',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2008}
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [auto1.de] INFO: Saving data for EU51889: {'auction_closing_time': 1774715946.0, 'created_time': 1774608304.061345, 'last_price_update_time': 1774695893.79041}
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU51889') HTTP/1.1" 204 0
2026-03-28 11:04:53 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-28 11:04:53 [auto1.de] INFO: Found listing with ID: NH03698
2026-03-28 11:04:53 [auto1.de] INFO: Found listing with ID: SC33158
2026-03-28 11:04:53 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-28 11:04:53 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-28 11:04:53 [auto1.de] INFO: Found listing with ID: XX31314
2026-03-28 11:04:53 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [auto1.de] INFO: Scrape type for SM20101: 2
2026-03-28 11:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101
2026-03-28 11:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27f0ebb0-c754-579c-811c-465a65648709 with scrape type 2
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27f0ebb0-c754-579c-811c-465a65648709 with scrape type 2
2026-03-28 11:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27f0ebb0-c754-579c-811c-465a65648709, identifier: SM20101
2026-03-28 11:04:53 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [auto1.de] INFO: Scrape type for AU97195: 2
2026-03-28 11:04:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195
2026-03-28 11:04:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817227d7-5e70-55be-9ac2-af7343b89aa2 with scrape type 2
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817227d7-5e70-55be-9ac2-af7343b89aa2 with scrape type 2
2026-03-28 11:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 817227d7-5e70-55be-9ac2-af7343b89aa2, identifier: AU97195
2026-03-28 11:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101
2026-03-28 11:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101
2026-03-28 11:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27f0ebb0-c754-579c-811c-465a65648709 with identifier: SM20101 to the API
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:18:49Z',
 'fuel_type': 'diesel',
 'id': '27f0ebb0-c754-579c-811c-465a65648709',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM20101',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 170810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-26',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [auto1.de] INFO: Saving data for SM20101: {'auction_closing_time': 1774714729.0, 'created_time': 1774608238.367077, 'last_price_update_time': 1774695894.349182}
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM20101') HTTP/1.1" 204 0
2026-03-28 11:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195
2026-03-28 11:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195
2026-03-28 11:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 817227d7-5e70-55be-9ac2-af7343b89aa2 with identifier: AU97195 to the API
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:04:50Z',
 'fuel_type': 'petrol',
 'id': '817227d7-5e70-55be-9ac2-af7343b89aa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU97195',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 26608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-10',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2020}
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [auto1.de] INFO: Saving data for AU97195: {'auction_closing_time': 1774713890.0, 'created_time': 1774608278.938039, 'last_price_update_time': 1774695894.839278}
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU97195') HTTP/1.1" 204 0
2026-03-28 11:04:54 [auto1.de] INFO: Found listing with ID: UK16576
2026-03-28 11:04:54 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [auto1.de] INFO: Scrape type for BR69139: 2
2026-03-28 11:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139
2026-03-28 11:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60eda562-9dc3-5285-9e14-2312e2ea5c86 with scrape type 2
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60eda562-9dc3-5285-9e14-2312e2ea5c86 with scrape type 2
2026-03-28 11:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60eda562-9dc3-5285-9e14-2312e2ea5c86, identifier: BR69139
2026-03-28 11:04:54 [auto1.de] INFO: Found listing with ID: NC61336
2026-03-28 11:04:54 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [auto1.de] INFO: Scrape type for FZ16195: 2
2026-03-28 11:04:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195
2026-03-28 11:04:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b313f4b8-a704-58de-820f-6f7a018d6704 with scrape type 2
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b313f4b8-a704-58de-820f-6f7a018d6704 with scrape type 2
2026-03-28 11:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b313f4b8-a704-58de-820f-6f7a018d6704, identifier: FZ16195
2026-03-28 11:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139
2026-03-28 11:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139
2026-03-28 11:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60eda562-9dc3-5285-9e14-2312e2ea5c86 with identifier: BR69139 to the API
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:18:50Z',
 'fuel_type': 'petrol',
 'id': '60eda562-9dc3-5285-9e14-2312e2ea5c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR69139',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 123085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'BMW 2er 220i Active Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-28 11:04:55 [auto1.de] INFO: Saving data for BR69139: {'auction_closing_time': 1774714730.0, 'created_time': 1774608354.263438, 'last_price_update_time': 1774695895.424592}
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR69139') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195
2026-03-28 11:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195
2026-03-28 11:04:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b313f4b8-a704-58de-820f-6f7a018d6704 with identifier: FZ16195 to the API
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:00:39Z',
 'fuel_type': 'diesel',
 'id': 'b313f4b8-a704-58de-820f-6f7a018d6704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ16195',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 194715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-02',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2012}
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-28 11:04:55 [auto1.de] INFO: Saving data for FZ16195: {'auction_closing_time': 1774713639.0, 'created_time': 1774608197.075871, 'last_price_update_time': 1774695895.748969}
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ16195') HTTP/1.1" 204 0
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-28 11:04:55 [auto1.de] INFO: Scrape type for JW75116: 2
2026-03-28 11:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116
2026-03-28 11:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40d94085-8df5-5065-b83a-9b9cf820ab25 with scrape type 2
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40d94085-8df5-5065-b83a-9b9cf820ab25 with scrape type 2
2026-03-28 11:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40d94085-8df5-5065-b83a-9b9cf820ab25, identifier: JW75116
2026-03-28 11:04:55 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-28 11:04:55 [auto1.de] INFO: Scrape type for BP38143: 2
2026-03-28 11:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143
2026-03-28 11:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec4c00af-b029-594d-889c-17500baaea76 with scrape type 2
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec4c00af-b029-594d-889c-17500baaea76 with scrape type 2
2026-03-28 11:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec4c00af-b029-594d-889c-17500baaea76, identifier: BP38143
2026-03-28 11:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116
2026-03-28 11:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116
2026-03-28 11:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40d94085-8df5-5065-b83a-9b9cf820ab25 with identifier: JW75116 to the API
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:47:35Z',
 'fuel_type': 'petrol',
 'id': '40d94085-8df5-5065-b83a-9b9cf820ab25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW75116',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLS-Klasse',
 'odometer': 219046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLS-Klasse GLS 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-28 11:04:56 [auto1.de] INFO: Saving data for JW75116: {'auction_closing_time': 1774716455.0, 'created_time': 1773917488.120116, 'last_price_update_time': 1774695896.371422}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW75116') HTTP/1.1" 204 0
2026-03-28 11:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143
2026-03-28 11:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143
2026-03-28 11:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec4c00af-b029-594d-889c-17500baaea76 with identifier: BP38143 to the API
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:30:44Z',
 'fuel_type': 'petrol',
 'id': 'ec4c00af-b029-594d-889c-17500baaea76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP38143',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 72173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-28 11:04:56 [auto1.de] INFO: Saving data for BP38143: {'auction_closing_time': 1774715444.0, 'created_time': 1773138586.995264, 'last_price_update_time': 1774695896.683187}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP38143') HTTP/1.1" 204 0
2026-03-28 11:04:56 [auto1.de] INFO: Found listing with ID: HL17570
2026-03-28 11:04:56 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-28 11:04:56 [auto1.de] INFO: Scrape type for PH87632: 2
2026-03-28 11:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632
2026-03-28 11:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with scrape type 2
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with scrape type 2
2026-03-28 11:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2, identifier: PH87632
2026-03-28 11:04:56 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-28 11:04:56 [auto1.de] INFO: Scrape type for HV64790: 2
2026-03-28 11:04:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790
2026-03-28 11:04:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with scrape type 2
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with scrape type 2
2026-03-28 11:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8, identifier: HV64790
2026-03-28 11:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632
2026-03-28 11:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632
2026-03-28 11:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7340ca4f-9b8b-5f3a-8bfe-63527741aad2 with identifier: PH87632 to the API
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:20:33Z',
 'fuel_type': 'diesel',
 'id': '7340ca4f-9b8b-5f3a-8bfe-63527741aad2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH87632',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 104045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-13',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 CDI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Saving data for PH87632: {'auction_closing_time': 1774714833.0, 'created_time': 1774608372.602594, 'last_price_update_time': 1774695897.225515}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH87632') HTTP/1.1" 204 0
2026-03-28 11:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790
2026-03-28 11:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790
2026-03-28 11:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8 with identifier: HV64790 to the API
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:33:10Z',
 'fuel_type': 'diesel',
 'id': 'a2d9c5c7-bbf0-5598-9094-d8ad1e90bdd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV64790',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 185594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'BMW 2er 218d Active Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Saving data for HV64790: {'auction_closing_time': 1774715590.0, 'created_time': 1774608348.986745, 'last_price_update_time': 1774695897.523495}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV64790') HTTP/1.1" 204 0
2026-03-28 11:04:57 [auto1.de] INFO: Found listing with ID: BZ40542
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ40542%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Scrape type for BZ40542: 2
2026-03-28 11:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2240abd-8546-503e-92ea-70f826eee45c with identifier: BZ40542
2026-03-28 11:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2240abd-8546-503e-92ea-70f826eee45c with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2240abd-8546-503e-92ea-70f826eee45c with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2240abd-8546-503e-92ea-70f826eee45c, identifier: BZ40542
2026-03-28 11:04:57 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [auto1.de] INFO: Scrape type for BT35414: 2
2026-03-28 11:04:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414
2026-03-28 11:04:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a639d3e-e7c2-5ee6-b485-571945b50668 with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a639d3e-e7c2-5ee6-b485-571945b50668 with scrape type 2
2026-03-28 11:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a639d3e-e7c2-5ee6-b485-571945b50668, identifier: BT35414
2026-03-28 11:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2240abd-8546-503e-92ea-70f826eee45c with identifier: BZ40542
2026-03-28 11:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2240abd-8546-503e-92ea-70f826eee45c with identifier: BZ40542
2026-03-28 11:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2240abd-8546-503e-92ea-70f826eee45c with identifier: BZ40542 to the API
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:12:41Z',
 'fuel_type': 'petrol',
 'id': 'b2240abd-8546-503e-92ea-70f826eee45c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ40542',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 43338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-27',
 'seller_name': None,
 'title': 'Jeep Compass 1.5 GSE T4 e-Hybrid Altitude',
 'transmission': 'automatic',
 'trim': 'Altitude',
 'year': 2024}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ40542%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [auto1.de] INFO: Saving data for BZ40542: {'auction_closing_time': 1774714361.0, 'created_time': 1774608240.880389, 'last_price_update_time': 1774695898.088498}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ40542') HTTP/1.1" 204 0
2026-03-28 11:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414
2026-03-28 11:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414
2026-03-28 11:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a639d3e-e7c2-5ee6-b485-571945b50668 with identifier: BT35414 to the API
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:42:09Z',
 'fuel_type': 'petrol',
 'id': '9a639d3e-e7c2-5ee6-b485-571945b50668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT35414',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 75308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-10',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [auto1.de] INFO: Saving data for BT35414: {'auction_closing_time': 1774716129.0, 'created_time': 1774608239.871469, 'last_price_update_time': 1774695898.517633}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT35414') HTTP/1.1" 204 0
2026-03-28 11:04:58 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-28 11:04:58 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [auto1.de] INFO: Scrape type for NU23717: 2
2026-03-28 11:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717
2026-03-28 11:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with scrape type 2
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with scrape type 2
2026-03-28 11:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6, identifier: NU23717
2026-03-28 11:04:58 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [auto1.de] INFO: Scrape type for TT67708: 2
2026-03-28 11:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708
2026-03-28 11:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with scrape type 2
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with scrape type 2
2026-03-28 11:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29, identifier: TT67708
2026-03-28 11:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717
2026-03-28 11:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717
2026-03-28 11:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d66bebd9-b7da-5ea7-a09b-5597a0b9a6e6 with identifier: NU23717 to the API
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:45:52Z',
 'fuel_type': 'diesel',
 'id': 'd66bebd9-b7da-5ea7-a09b-5597a0b9a6e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU23717',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 215538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [auto1.de] INFO: Saving data for NU23717: {'auction_closing_time': 1774716352.0, 'created_time': 1774607766.965094, 'last_price_update_time': 1774695899.048291}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU23717') HTTP/1.1" 204 0
2026-03-28 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708
2026-03-28 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708
2026-03-28 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5e2a440-ab5f-5aac-b6b5-b1a3aa158d29 with identifier: TT67708 to the API
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:33:43Z',
 'fuel_type': 'petrol',
 'id': 'd5e2a440-ab5f-5aac-b6b5-b1a3aa158d29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT67708',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 146568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-03',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [auto1.de] INFO: Saving data for TT67708: {'auction_closing_time': 1774715623.0, 'created_time': 1773380656.297527, 'last_price_update_time': 1774695899.385035}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT67708') HTTP/1.1" 204 0
2026-03-28 11:04:59 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [auto1.de] INFO: Scrape type for GC84828: 2
2026-03-28 11:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828
2026-03-28 11:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item befc586c-e755-5a3b-9eac-511e3c17da8e with scrape type 2
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item befc586c-e755-5a3b-9eac-511e3c17da8e with scrape type 2
2026-03-28 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: befc586c-e755-5a3b-9eac-511e3c17da8e, identifier: GC84828
2026-03-28 11:04:59 [auto1.de] INFO: Found listing with ID: BY27711
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY27711%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [auto1.de] INFO: Scrape type for BY27711: 2
2026-03-28 11:04:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with identifier: BY27711
2026-03-28 11:04:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with scrape type 2
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with scrape type 2
2026-03-28 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041, identifier: BY27711
2026-03-28 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828
2026-03-28 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828
2026-03-28 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: befc586c-e755-5a3b-9eac-511e3c17da8e with identifier: GC84828 to the API
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:37:09Z',
 'fuel_type': 'petrol',
 'id': 'befc586c-e755-5a3b-9eac-511e3c17da8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC84828',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 22334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-07',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2023}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [auto1.de] INFO: Saving data for GC84828: {'auction_closing_time': 1774715829.0, 'created_time': 1774607778.537597, 'last_price_update_time': 1774695899.922049}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC84828') HTTP/1.1" 204 0
2026-03-28 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with identifier: BY27711
2026-03-28 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with identifier: BY27711
2026-03-28 11:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49f266ec-86ce-5b3f-9d5c-96c75ba2b041 with identifier: BY27711 to the API
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:05:20Z',
 'fuel_type': 'diesel',
 'id': '49f266ec-86ce-5b3f-9d5c-96c75ba2b041',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY27711',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 163803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'BlueTEC AMG Line',
 'year': 2018}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY27711%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [auto1.de] INFO: Saving data for BY27711: {'auction_closing_time': 1774713920.0, 'created_time': 1774607776.701759, 'last_price_update_time': 1774695900.336193}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY27711') HTTP/1.1" 204 0
2026-03-28 11:05:00 [auto1.de] INFO: Found listing with ID: LF68869
2026-03-28 11:05:00 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-28 11:05:00 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [auto1.de] INFO: Scrape type for UB26055: 2
2026-03-28 11:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055
2026-03-28 11:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with scrape type 2
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with scrape type 2
2026-03-28 11:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f, identifier: UB26055
2026-03-28 11:05:00 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [auto1.de] INFO: Scrape type for NE15652: 2
2026-03-28 11:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652
2026-03-28 11:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bfbccf7-7c56-5133-902d-fff59677f178 with scrape type 2
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bfbccf7-7c56-5133-902d-fff59677f178 with scrape type 2
2026-03-28 11:05:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bfbccf7-7c56-5133-902d-fff59677f178, identifier: NE15652
2026-03-28 11:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055
2026-03-28 11:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055
2026-03-28 11:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f with identifier: UB26055 to the API
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:22:04Z',
 'fuel_type': 'petrol',
 'id': '4d6d8d58-f8a8-5afa-9b64-cf47c9d2ef1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB26055',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 120341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-12',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2016}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [auto1.de] INFO: Saving data for UB26055: {'auction_closing_time': 1774714924.0, 'created_time': 1774607802.946892, 'last_price_update_time': 1774695900.919438}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB26055') HTTP/1.1" 204 0
2026-03-28 11:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652
2026-03-28 11:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652
2026-03-28 11:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bfbccf7-7c56-5133-902d-fff59677f178 with identifier: NE15652 to the API
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-28T16:09:15Z',
 'fuel_type': 'petrol',
 'id': '1bfbccf7-7c56-5133-902d-fff59677f178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE15652',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 166645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-04',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Pure',
 'transmission': 'manual',
 'trim': 'Pure',
 'year': 2019}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [auto1.de] INFO: Saving data for NE15652: {'auction_closing_time': 1774714155.0, 'created_time': 1774607763.861742, 'last_price_update_time': 1774695901.314058}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE15652') HTTP/1.1" 204 0
2026-03-28 11:05:01 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [auto1.de] INFO: Scrape type for LG85121: 2
2026-03-28 11:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121
2026-03-28 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9585bbde-b3a0-52ac-929a-11474f11909b with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9585bbde-b3a0-52ac-929a-11474f11909b with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9585bbde-b3a0-52ac-929a-11474f11909b, identifier: LG85121
2026-03-28 11:05:01 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [auto1.de] INFO: Scrape type for UZ82929: 2
2026-03-28 11:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929
2026-03-28 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27bb1249-b18c-5c8c-9e08-9cae316cae5c with scrape type 2
2026-03-28 11:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27bb1249-b18c-5c8c-9e08-9cae316cae5c, identifier: UZ82929
2026-03-28 11:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121
2026-03-28 11:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121
2026-03-28 11:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9585bbde-b3a0-52ac-929a-11474f11909b with identifier: LG85121 to the API
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:48:22Z',
 'fuel_type': 'diesel',
 'id': '9585bbde-b3a0-52ac-929a-11474f11909b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG85121',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 91626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Energy BOSE-Edition',
 'transmission': 'automatic',
 'trim': 'BOSE-Edition',
 'year': 2017}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [auto1.de] INFO: Saving data for LG85121: {'auction_closing_time': 1774716502.0, 'created_time': 1773136202.743044, 'last_price_update_time': 1774695901.864038}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG85121') HTTP/1.1" 204 0
2026-03-28 11:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929
2026-03-28 11:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929
2026-03-28 11:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27bb1249-b18c-5c8c-9e08-9cae316cae5c with identifier: UZ82929 to the API
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:04:54Z',
 'fuel_type': 'diesel',
 'id': '27bb1249-b18c-5c8c-9e08-9cae316cae5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ82929',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 267160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-05',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Black Shadow 4x2',
 'transmission': 'manual',
 'trim': 'Black Shadow 4x2',
 'year': 2016}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [auto1.de] INFO: Saving data for UZ82929: {'auction_closing_time': 1774713894.0, 'created_time': 1774607782.625442, 'last_price_update_time': 1774695902.262464}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ82929') HTTP/1.1" 204 0
2026-03-28 11:05:02 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [auto1.de] INFO: Scrape type for CR88792: 2
2026-03-28 11:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792
2026-03-28 11:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ade2caca-3bbf-512f-962d-1cfe8490ba3a with scrape type 2
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ade2caca-3bbf-512f-962d-1cfe8490ba3a with scrape type 2
2026-03-28 11:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ade2caca-3bbf-512f-962d-1cfe8490ba3a, identifier: CR88792
2026-03-28 11:05:02 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [auto1.de] INFO: Scrape type for LH67751: 2
2026-03-28 11:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751
2026-03-28 11:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baeb855d-c619-571d-8227-3504a3316b6a with scrape type 2
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baeb855d-c619-571d-8227-3504a3316b6a with scrape type 2
2026-03-28 11:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baeb855d-c619-571d-8227-3504a3316b6a, identifier: LH67751
2026-03-28 11:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792
2026-03-28 11:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792
2026-03-28 11:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ade2caca-3bbf-512f-962d-1cfe8490ba3a with identifier: CR88792 to the API
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:13:51Z',
 'fuel_type': 'petrol',
 'id': 'ade2caca-3bbf-512f-962d-1cfe8490ba3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR88792',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 144392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-22',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2016}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [auto1.de] INFO: Saving data for CR88792: {'auction_closing_time': 1774714431.0, 'created_time': 1774607813.636578, 'last_price_update_time': 1774695902.806731}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR88792') HTTP/1.1" 204 0
2026-03-28 11:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751
2026-03-28 11:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751
2026-03-28 11:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baeb855d-c619-571d-8227-3504a3316b6a with identifier: LH67751 to the API
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:37:22Z',
 'fuel_type': 'petrol',
 'id': 'baeb855d-c619-571d-8227-3504a3316b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH67751',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 65035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-23',
 'seller_name': None,
 'title': 'Renault Captur 1.2 TCe Luxe',
 'transmission': 'automatic',
 'trim': 'Luxe',
 'year': 2014}
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [auto1.de] INFO: Saving data for LH67751: {'auction_closing_time': 1774715842.0, 'created_time': 1774608194.716891, 'last_price_update_time': 1774695903.097736}
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH67751') HTTP/1.1" 204 0
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: RF57736
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF57736%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [auto1.de] INFO: Scrape type for RF57736: 2
2026-03-28 11:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a85389bb-8ff1-5858-9efd-d645ce49dcd6 with identifier: RF57736
2026-03-28 11:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a85389bb-8ff1-5858-9efd-d645ce49dcd6 with scrape type 2
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a85389bb-8ff1-5858-9efd-d645ce49dcd6 with scrape type 2
2026-03-28 11:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a85389bb-8ff1-5858-9efd-d645ce49dcd6, identifier: RF57736
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-28 11:05:03 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [auto1.de] INFO: Scrape type for EC33750: 2
2026-03-28 11:05:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750
2026-03-28 11:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f15e52c7-f347-5b54-90a2-8994327b9a7d with scrape type 2
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f15e52c7-f347-5b54-90a2-8994327b9a7d with scrape type 2
2026-03-28 11:05:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f15e52c7-f347-5b54-90a2-8994327b9a7d, identifier: EC33750
2026-03-28 11:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a85389bb-8ff1-5858-9efd-d645ce49dcd6 with identifier: RF57736
2026-03-28 11:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a85389bb-8ff1-5858-9efd-d645ce49dcd6 with identifier: RF57736
2026-03-28 11:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a85389bb-8ff1-5858-9efd-d645ce49dcd6 with identifier: RF57736 to the API
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:21:14Z',
 'fuel_type': 'petrol',
 'id': 'a85389bb-8ff1-5858-9efd-d645ce49dcd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF57736',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 131030,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-04',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2011}
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF57736%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [auto1.de] INFO: Saving data for RF57736: {'auction_closing_time': 1774714874.0, 'created_time': 1774607780.926338, 'last_price_update_time': 1774695903.723054}
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF57736') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750
2026-03-28 11:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750
2026-03-28 11:05:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f15e52c7-f347-5b54-90a2-8994327b9a7d with identifier: EC33750 to the API
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:22Z',
 'fuel_type': 'diesel',
 'id': 'f15e52c7-f347-5b54-90a2-8994327b9a7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC33750',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 149514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-14',
 'seller_name': None,
 'title': 'Mitsubishi ASX 2.2 DI-D Edition 100+ 4WD',
 'transmission': 'automatic',
 'trim': 'Edition 100+ 4WD',
 'year': 2017}
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-28 11:05:04 [auto1.de] INFO: Saving data for EC33750: {'auction_closing_time': 1774716742.0, 'created_time': 1774350446.49065, 'last_price_update_time': 1774695904.075299}
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC33750') HTTP/1.1" 204 0
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: JL47940
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: ZD23716
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: RG24592
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG24592%27 HTTP/1.1" 200 None
2026-03-28 11:05:04 [auto1.de] INFO: Scrape type for RG24592: 2
2026-03-28 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8030f373-9224-5af6-91df-0fd2caf4c796 with identifier: RG24592
2026-03-28 11:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8030f373-9224-5af6-91df-0fd2caf4c796 with scrape type 2
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8030f373-9224-5af6-91df-0fd2caf4c796 with scrape type 2
2026-03-28 11:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8030f373-9224-5af6-91df-0fd2caf4c796, identifier: RG24592
2026-03-28 11:05:04 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-28 11:05:04 [auto1.de] INFO: Scrape type for TS01373: 2
2026-03-28 11:05:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373
2026-03-28 11:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fe319b1-9968-5a96-9201-ef26ae508395 with scrape type 2
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fe319b1-9968-5a96-9201-ef26ae508395 with scrape type 2
2026-03-28 11:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fe319b1-9968-5a96-9201-ef26ae508395, identifier: TS01373
2026-03-28 11:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8030f373-9224-5af6-91df-0fd2caf4c796 with identifier: RG24592
2026-03-28 11:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8030f373-9224-5af6-91df-0fd2caf4c796 with identifier: RG24592
2026-03-28 11:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8030f373-9224-5af6-91df-0fd2caf4c796 with identifier: RG24592 to the API
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:15:51Z',
 'fuel_type': 'diesel',
 'id': '8030f373-9224-5af6-91df-0fd2caf4c796',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG24592',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 168441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-22',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2013}
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG24592%27 HTTP/1.1" 200 None
2026-03-28 11:05:04 [auto1.de] INFO: Saving data for RG24592: {'auction_closing_time': 1774714551.0, 'created_time': 1774607770.774253, 'last_price_update_time': 1774695904.798858}
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG24592') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373
2026-03-28 11:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373
2026-03-28 11:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fe319b1-9968-5a96-9201-ef26ae508395 with identifier: TS01373 to the API
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:59:30Z',
 'fuel_type': 'petrol',
 'id': '5fe319b1-9968-5a96-9201-ef26ae508395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS01373',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 70434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-01',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-28 11:05:05 [auto1.de] INFO: Saving data for TS01373: {'auction_closing_time': 1774717170.0, 'created_time': 1774607769.045483, 'last_price_update_time': 1774695905.31464}
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS01373') HTTP/1.1" 204 0
2026-03-28 11:05:05 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-28 11:05:05 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-28 11:05:05 [auto1.de] INFO: Scrape type for BE15343: 2
2026-03-28 11:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343
2026-03-28 11:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d with scrape type 2
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c47b4df3-a17d-5f37-868c-ff87d9fdd66d with scrape type 2
2026-03-28 11:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c47b4df3-a17d-5f37-868c-ff87d9fdd66d, identifier: BE15343
2026-03-28 11:05:05 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-28 11:05:05 [auto1.de] INFO: Scrape type for FX17488: 2
2026-03-28 11:05:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488
2026-03-28 11:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with scrape type 2
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with scrape type 2
2026-03-28 11:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce, identifier: FX17488
2026-03-28 11:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343
2026-03-28 11:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343
2026-03-28 11:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c47b4df3-a17d-5f37-868c-ff87d9fdd66d with identifier: BE15343 to the API
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:32:57Z',
 'fuel_type': 'diesel',
 'id': 'c47b4df3-a17d-5f37-868c-ff87d9fdd66d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE15343',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 37227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-28 11:05:06 [auto1.de] INFO: Saving data for BE15343: {'auction_closing_time': 1774715577.0, 'created_time': 1774607830.081576, 'last_price_update_time': 1774695906.101618}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE15343') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488
2026-03-28 11:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488
2026-03-28 11:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84cd7975-bae1-561f-9649-3a0e1ba3e1ce with identifier: FX17488 to the API
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-28T16:26:16Z',
 'fuel_type': 'petrol',
 'id': '84cd7975-bae1-561f-9649-3a0e1ba3e1ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX17488',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS Q3 Sportback',
 'odometer': 92066,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-21',
 'seller_name': None,
 'title': 'Audi RS Q3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-28 11:05:06 [auto1.de] INFO: Saving data for FX17488: {'auction_closing_time': 1774715176.0, 'created_time': 1773917376.402283, 'last_price_update_time': 1774695906.513143}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX17488') HTTP/1.1" 204 0
2026-03-28 11:05:06 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-28 11:05:06 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-28 11:05:06 [auto1.de] INFO: Scrape type for CK62580: 2
2026-03-28 11:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580
2026-03-28 11:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with scrape type 2
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with scrape type 2
2026-03-28 11:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76, identifier: CK62580
2026-03-28 11:05:06 [scrapy.extensions.logstats] INFO: Crawled 415 pages (at 4 pages/min), scraped 301 items (at 80 items/min)
2026-03-28 11:05:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:05:06 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-28 11:05:06 [auto1.de] INFO: Scrape type for JG50197: 2
2026-03-28 11:05:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197
2026-03-28 11:05:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d1a52c8-32fb-52bb-baa1-45002def6da1 with scrape type 2
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d1a52c8-32fb-52bb-baa1-45002def6da1 with scrape type 2
2026-03-28 11:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d1a52c8-32fb-52bb-baa1-45002def6da1, identifier: JG50197
2026-03-28 11:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580
2026-03-28 11:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580
2026-03-28 11:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76 with identifier: CK62580 to the API
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:23:35Z',
 'fuel_type': 'petrol',
 'id': '08ec2d3b-a031-5ce1-ac8e-8e0db3c23c76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK62580',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 95626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-28',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 MyLive',
 'transmission': 'manual',
 'trim': 'MyLive',
 'year': 2012}
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-28 11:05:07 [auto1.de] INFO: Saving data for CK62580: {'auction_closing_time': 1774715015.0, 'created_time': 1774607828.159244, 'last_price_update_time': 1774695907.078212}
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK62580') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197
2026-03-28 11:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197
2026-03-28 11:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d1a52c8-32fb-52bb-baa1-45002def6da1 with identifier: JG50197 to the API
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:29:18Z',
 'fuel_type': 'petrol',
 'id': '8d1a52c8-32fb-52bb-baa1-45002def6da1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG50197',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 205500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-28 11:05:07 [auto1.de] INFO: Saving data for JG50197: {'auction_closing_time': 1774715358.0, 'created_time': 1774608302.013792, 'last_price_update_time': 1774695907.463437}
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG50197') HTTP/1.1" 204 0
2026-03-28 11:05:07 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-28 11:05:07 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-28 11:05:07 [auto1.de] INFO: Scrape type for ZP86837: 2
2026-03-28 11:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837
2026-03-28 11:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 085ceaf3-cddf-54c6-b445-9790d7063277 with scrape type 2
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 085ceaf3-cddf-54c6-b445-9790d7063277 with scrape type 2
2026-03-28 11:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 085ceaf3-cddf-54c6-b445-9790d7063277, identifier: ZP86837
2026-03-28 11:05:07 [auto1.de] INFO: Found listing with ID: CD24001
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD24001%27 HTTP/1.1" 200 None
2026-03-28 11:05:07 [auto1.de] INFO: Scrape type for CD24001: 2
2026-03-28 11:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6f4b72b-c128-5bb6-a710-28f358bb1efa with identifier: CD24001
2026-03-28 11:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f4b72b-c128-5bb6-a710-28f358bb1efa with scrape type 2
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6f4b72b-c128-5bb6-a710-28f358bb1efa with scrape type 2
2026-03-28 11:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6f4b72b-c128-5bb6-a710-28f358bb1efa, identifier: CD24001
2026-03-28 11:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837
2026-03-28 11:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837
2026-03-28 11:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 085ceaf3-cddf-54c6-b445-9790d7063277 with identifier: ZP86837 to the API
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:49:38Z',
 'fuel_type': 'diesel',
 'id': '085ceaf3-cddf-54c6-b445-9790d7063277',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP86837',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 43102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-28 11:05:08 [auto1.de] INFO: Saving data for ZP86837: {'auction_closing_time': 1774716578.0, 'created_time': 1774607834.379843, 'last_price_update_time': 1774695908.080782}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP86837') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6f4b72b-c128-5bb6-a710-28f358bb1efa with identifier: CD24001
2026-03-28 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6f4b72b-c128-5bb6-a710-28f358bb1efa with identifier: CD24001
2026-03-28 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6f4b72b-c128-5bb6-a710-28f358bb1efa with identifier: CD24001 to the API
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:53:32Z',
 'fuel_type': 'diesel',
 'id': 'b6f4b72b-c128-5bb6-a710-28f358bb1efa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD24001',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 406669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-27',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD24001%27 HTTP/1.1" 200 None
2026-03-28 11:05:08 [auto1.de] INFO: Saving data for CD24001: {'auction_closing_time': 1774716812.0, 'created_time': 1774608233.482674, 'last_price_update_time': 1774695908.375456}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD24001') HTTP/1.1" 204 0
2026-03-28 11:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:08 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 9702 | hits on page: 40
2026-03-28 11:05:08 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-28 11:05:08 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-28 11:05:08 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-28 11:05:08 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-28 11:05:08 [auto1.de] INFO: Scrape type for BD42318: 2
2026-03-28 11:05:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318
2026-03-28 11:05:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with scrape type 2
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with scrape type 2
2026-03-28 11:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875, identifier: BD42318
2026-03-28 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318
2026-03-28 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318
2026-03-28 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc54d6a4-0fb1-5961-bd3c-16f3cb81a875 with identifier: BD42318 to the API
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:17:59Z',
 'fuel_type': 'diesel',
 'id': 'fc54d6a4-0fb1-5961-bd3c-16f3cb81a875',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD42318',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 237268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-13',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2018}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-28 11:05:08 [auto1.de] INFO: Saving data for BD42318: {'auction_closing_time': 1774714679.0, 'created_time': 1773228097.361381, 'last_price_update_time': 1774695908.942313}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD42318') HTTP/1.1" 204 0
2026-03-28 11:05:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Scrape type for WR03810: 2
2026-03-28 11:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810
2026-03-28 11:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with scrape type 2
2026-03-28 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with scrape type 2
2026-03-28 11:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9f5d2dd-41f6-51fe-9541-1e1f00d44311, identifier: WR03810
2026-03-28 11:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810
2026-03-28 11:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810
2026-03-28 11:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9f5d2dd-41f6-51fe-9541-1e1f00d44311 with identifier: WR03810 to the API
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:17:37Z',
 'fuel_type': 'diesel',
 'id': 'b9f5d2dd-41f6-51fe-9541-1e1f00d44311',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR03810',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Express',
 'odometer': 94309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-23',
 'seller_name': None,
 'title': 'Renault Express 1.5 BLUE dCi Extra',
 'transmission': 'manual',
 'trim': 'Extra',
 'year': 2022}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Saving data for WR03810: {'auction_closing_time': 1774714657.0, 'created_time': 1774607840.606156, 'last_price_update_time': 1774695909.468877}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR03810') HTTP/1.1" 204 0
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Scrape type for YR74432: 2
2026-03-28 11:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432
2026-03-28 11:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with scrape type 2
2026-03-28 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with scrape type 2
2026-03-28 11:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cc4cd8e-8bcf-5a22-bd34-30f574283794, identifier: YR74432
2026-03-28 11:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432
2026-03-28 11:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432
2026-03-28 11:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cc4cd8e-8bcf-5a22-bd34-30f574283794 with identifier: YR74432 to the API
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:53:03Z',
 'fuel_type': 'petrol',
 'id': '0cc4cd8e-8bcf-5a22-bd34-30f574283794',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR74432',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 150471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Saving data for YR74432: {'auction_closing_time': 1774716783.0, 'created_time': 1774608098.64953, 'last_price_update_time': 1774695909.949589}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR74432') HTTP/1.1" 204 0
2026-03-28 11:05:09 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [auto1.de] INFO: Scrape type for PR23937: 2
2026-03-28 11:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937
2026-03-28 11:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce06b55-bcd3-51ca-a2df-9964fa37f093 with scrape type 2
2026-03-28 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cce06b55-bcd3-51ca-a2df-9964fa37f093 with scrape type 2
2026-03-28 11:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cce06b55-bcd3-51ca-a2df-9964fa37f093, identifier: PR23937
2026-03-28 11:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937
2026-03-28 11:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937
2026-03-28 11:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cce06b55-bcd3-51ca-a2df-9964fa37f093 with identifier: PR23937 to the API
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:27:17Z',
 'fuel_type': 'diesel',
 'id': 'cce06b55-bcd3-51ca-a2df-9964fa37f093',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR23937',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 199491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-14',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [auto1.de] INFO: Saving data for PR23937: {'auction_closing_time': 1774715237.0, 'created_time': 1774607872.255165, 'last_price_update_time': 1774695910.381735}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR23937') HTTP/1.1" 204 0
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: WN28352
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN28352%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [auto1.de] INFO: Scrape type for WN28352: 2
2026-03-28 11:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with identifier: WN28352
2026-03-28 11:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with scrape type 2
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with scrape type 2
2026-03-28 11:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9, identifier: WN28352
2026-03-28 11:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with identifier: WN28352
2026-03-28 11:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with identifier: WN28352
2026-03-28 11:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e54fa90-1f36-582e-8fcb-d49035d1a9d9 with identifier: WN28352 to the API
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:35:10Z',
 'fuel_type': 'petrol',
 'id': '8e54fa90-1f36-582e-8fcb-d49035d1a9d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN28352',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C2',
 'odometer': 112687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-10-20',
 'seller_name': None,
 'title': 'Citroen C2 1.4 VSX',
 'transmission': 'manual',
 'trim': 'VSX',
 'year': 2004}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN28352%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [auto1.de] INFO: Saving data for WN28352: {'auction_closing_time': 1774715710.0, 'created_time': 1774607883.158682, 'last_price_update_time': 1774695910.857552}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN28352') HTTP/1.1" 204 0
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-28 11:05:10 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [auto1.de] INFO: Scrape type for JD23896: 2
2026-03-28 11:05:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896
2026-03-28 11:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea31509-2755-54ef-b527-7af6b42eddcc with scrape type 2
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ea31509-2755-54ef-b527-7af6b42eddcc with scrape type 2
2026-03-28 11:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ea31509-2755-54ef-b527-7af6b42eddcc, identifier: JD23896
2026-03-28 11:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896
2026-03-28 11:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896
2026-03-28 11:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ea31509-2755-54ef-b527-7af6b42eddcc with identifier: JD23896 to the API
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:35Z',
 'fuel_type': 'petrol',
 'id': '4ea31509-2755-54ef-b527-7af6b42eddcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD23896',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 76174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-08',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2016}
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-28 11:05:11 [auto1.de] INFO: Saving data for JD23896: {'auction_closing_time': 1774715975.0, 'created_time': 1774607776.288624, 'last_price_update_time': 1774695911.459306}
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD23896') HTTP/1.1" 204 0
2026-03-28 11:05:11 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-28 11:05:11 [auto1.de] INFO: Scrape type for WZ14073: 2
2026-03-28 11:05:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073
2026-03-28 11:05:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b3067c3-6224-5209-a487-6c2423e66851 with scrape type 2
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b3067c3-6224-5209-a487-6c2423e66851 with scrape type 2
2026-03-28 11:05:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b3067c3-6224-5209-a487-6c2423e66851, identifier: WZ14073
2026-03-28 11:05:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073
2026-03-28 11:05:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073
2026-03-28 11:05:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b3067c3-6224-5209-a487-6c2423e66851 with identifier: WZ14073 to the API
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:33:20Z',
 'fuel_type': 'petrol',
 'id': '6b3067c3-6224-5209-a487-6c2423e66851',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ14073',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 109419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-20',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-28 11:05:12 [auto1.de] INFO: Saving data for WZ14073: {'auction_closing_time': 1774715600.0, 'created_time': 1774607833.785624, 'last_price_update_time': 1774695912.133953}
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ14073') HTTP/1.1" 204 0
2026-03-28 11:05:12 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-28 11:05:12 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-28 11:05:12 [auto1.de] INFO: Scrape type for JB03726: 2
2026-03-28 11:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726
2026-03-28 11:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb7cb431-cfe0-5600-9637-9f23e580151b with scrape type 2
2026-03-28 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb7cb431-cfe0-5600-9637-9f23e580151b with scrape type 2
2026-03-28 11:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb7cb431-cfe0-5600-9637-9f23e580151b, identifier: JB03726
2026-03-28 11:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726
2026-03-28 11:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726
2026-03-28 11:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb7cb431-cfe0-5600-9637-9f23e580151b with identifier: JB03726 to the API
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:38:14Z',
 'fuel_type': 'diesel',
 'id': 'bb7cb431-cfe0-5600-9637-9f23e580151b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB03726',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 149175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-25',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [auto1.de] INFO: Saving data for JB03726: {'auction_closing_time': 1774715894.0, 'created_time': 1773341203.426903, 'last_price_update_time': 1774695913.105019}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB03726') HTTP/1.1" 204 0
2026-03-28 11:05:13 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-28 11:05:13 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [auto1.de] INFO: Scrape type for GJ05712: 2
2026-03-28 11:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712
2026-03-28 11:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 229e9702-9c5e-5161-a439-cf962bb05127 with scrape type 2
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 229e9702-9c5e-5161-a439-cf962bb05127 with scrape type 2
2026-03-28 11:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 229e9702-9c5e-5161-a439-cf962bb05127, identifier: GJ05712
2026-03-28 11:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712
2026-03-28 11:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712
2026-03-28 11:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 229e9702-9c5e-5161-a439-cf962bb05127 with identifier: GJ05712 to the API
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:24:58Z',
 'fuel_type': 'petrol',
 'id': '229e9702-9c5e-5161-a439-cf962bb05127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ05712',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 199160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2013}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [auto1.de] INFO: Saving data for GJ05712: {'auction_closing_time': 1774715098.0, 'created_time': 1773383453.145624, 'last_price_update_time': 1774695913.701131}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ05712') HTTP/1.1" 204 0
2026-03-28 11:05:13 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [auto1.de] INFO: Scrape type for KK06519: 2
2026-03-28 11:05:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519
2026-03-28 11:05:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0146879-0287-542e-b052-34b9c77493ae with scrape type 2
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0146879-0287-542e-b052-34b9c77493ae with scrape type 2
2026-03-28 11:05:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0146879-0287-542e-b052-34b9c77493ae, identifier: KK06519
2026-03-28 11:05:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519
2026-03-28 11:05:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519
2026-03-28 11:05:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0146879-0287-542e-b052-34b9c77493ae with identifier: KK06519 to the API
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:33:15Z',
 'fuel_type': 'diesel',
 'id': 'c0146879-0287-542e-b052-34b9c77493ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK06519',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 112733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Jaguar XE 20d Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2015}
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.de] INFO: Saving data for KK06519: {'auction_closing_time': 1774715595.0, 'created_time': 1774034603.13968, 'last_price_update_time': 1774695914.254356}
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK06519') HTTP/1.1" 204 0
2026-03-28 11:05:14 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.de] INFO: Scrape type for KT29520: 2
2026-03-28 11:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520
2026-03-28 11:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eee42b4-2ad0-567f-a8dd-08305af2d577 with scrape type 2
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6eee42b4-2ad0-567f-a8dd-08305af2d577 with scrape type 2
2026-03-28 11:05:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eee42b4-2ad0-567f-a8dd-08305af2d577, identifier: KT29520
2026-03-28 11:05:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520
2026-03-28 11:05:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520
2026-03-28 11:05:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eee42b4-2ad0-567f-a8dd-08305af2d577 with identifier: KT29520 to the API
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:23:46Z',
 'fuel_type': 'hybrid',
 'id': '6eee42b4-2ad0-567f-a8dd-08305af2d577',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT29520',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 40379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-18',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 Hybrid 4 300 GT',
 'transmission': 'automatic',
 'trim': '4 300 GT',
 'year': 2022}
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.de] INFO: Saving data for KT29520: {'auction_closing_time': 1774715026.0, 'created_time': 1774607812.845102, 'last_price_update_time': 1774695914.868801}
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT29520') HTTP/1.1" 204 0
2026-03-28 11:05:14 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [auto1.de] INFO: Scrape type for AB35938: 2
2026-03-28 11:05:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938
2026-03-28 11:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with scrape type 2
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with scrape type 2
2026-03-28 11:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b, identifier: AB35938
2026-03-28 11:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938
2026-03-28 11:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938
2026-03-28 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b with identifier: AB35938 to the API
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:53:09Z',
 'fuel_type': 'petrol',
 'id': '9ec1ea6c-a5d5-522b-adc3-fbd9bb4e582b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB35938',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 127928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-19',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Style Viva',
 'transmission': 'manual',
 'trim': 'Style Viva',
 'year': 2012}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.de] INFO: Saving data for AB35938: {'auction_closing_time': 1774716789.0, 'created_time': 1774607810.917283, 'last_price_update_time': 1774695915.47872}
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB35938') HTTP/1.1" 204 0
2026-03-28 11:05:15 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-28 11:05:15 [auto1.de] INFO: Found listing with ID: TR96754
2026-03-28 11:05:15 [auto1.de] INFO: Found listing with ID: RP70991
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP70991%27 HTTP/1.1" 200 None
2026-03-28 11:05:15 [auto1.de] INFO: Scrape type for RP70991: 2
2026-03-28 11:05:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with identifier: RP70991
2026-03-28 11:05:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with scrape type 2
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with scrape type 2
2026-03-28 11:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca, identifier: RP70991
2026-03-28 11:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with identifier: RP70991
2026-03-28 11:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with identifier: RP70991
2026-03-28 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca with identifier: RP70991 to the API
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-28T16:36:01Z',
 'fuel_type': 'petrol',
 'id': '08bf72dd-5bbf-5ac3-b0c0-ff700274b8ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP70991',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '911',
 'odometer': 93486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-07',
 'seller_name': None,
 'title': 'Porsche 911 997 Carrera S Cabrio',
 'transmission': 'manual',
 'trim': 'Carrera S Cabrio',
 'year': 2008}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP70991%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.de] INFO: Saving data for RP70991: {'auction_closing_time': 1774715761.0, 'created_time': 1774607860.319753, 'last_price_update_time': 1774695916.101898}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP70991') HTTP/1.1" 204 0
2026-03-28 11:05:16 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-28 11:05:16 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.de] INFO: Scrape type for TX63688: 2
2026-03-28 11:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688
2026-03-28 11:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6328d2a1-39c1-5106-9e54-ce92a4d90535 with scrape type 2
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6328d2a1-39c1-5106-9e54-ce92a4d90535 with scrape type 2
2026-03-28 11:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6328d2a1-39c1-5106-9e54-ce92a4d90535, identifier: TX63688
2026-03-28 11:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688
2026-03-28 11:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688
2026-03-28 11:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6328d2a1-39c1-5106-9e54-ce92a4d90535 with identifier: TX63688 to the API
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:50:47Z',
 'fuel_type': 'diesel',
 'id': '6328d2a1-39c1-5106-9e54-ce92a4d90535',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX63688',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 77192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-23',
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
 'transmission': 'manual',
 'trim': 'Allure Pack',
 'year': 2021}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.de] INFO: Saving data for TX63688: {'auction_closing_time': 1774716647.0, 'created_time': 1774607867.468872, 'last_price_update_time': 1774695916.584701}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX63688') HTTP/1.1" 204 0
2026-03-28 11:05:16 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [auto1.de] INFO: Scrape type for SM09769: 2
2026-03-28 11:05:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769
2026-03-28 11:05:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with scrape type 2
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with scrape type 2
2026-03-28 11:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53, identifier: SM09769
2026-03-28 11:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769
2026-03-28 11:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769
2026-03-28 11:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53 with identifier: SM09769 to the API
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:45:58Z',
 'fuel_type': 'petrol',
 'id': '89f0bc23-3e7f-5a44-a7d1-d2fe567a7b53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM09769',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 86870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [auto1.de] INFO: Saving data for SM09769: {'auction_closing_time': 1774716358.0, 'created_time': 1774607842.094719, 'last_price_update_time': 1774695917.202745}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM09769') HTTP/1.1" 204 0
2026-03-28 11:05:17 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [auto1.de] INFO: Scrape type for HY59950: 2
2026-03-28 11:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950
2026-03-28 11:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e06db99-904f-5866-97f1-b18f223595fa with scrape type 2
2026-03-28 11:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e06db99-904f-5866-97f1-b18f223595fa with scrape type 2
2026-03-28 11:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e06db99-904f-5866-97f1-b18f223595fa, identifier: HY59950
2026-03-28 11:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950
2026-03-28 11:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950
2026-03-28 11:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e06db99-904f-5866-97f1-b18f223595fa with identifier: HY59950 to the API
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:28:56Z',
 'fuel_type': 'petrol',
 'id': '1e06db99-904f-5866-97f1-b18f223595fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY59950',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 36782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-06',
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Pack',
 'transmission': 'automatic',
 'trim': 'Allure Pack',
 'year': 2023}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [auto1.de] INFO: Saving data for HY59950: {'auction_closing_time': 1774715336.0, 'created_time': 1774607780.063269, 'last_price_update_time': 1774695917.646337}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY59950') HTTP/1.1" 204 0
2026-03-28 11:05:17 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-28 11:05:17 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [auto1.de] INFO: Scrape type for TP66547: 2
2026-03-28 11:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547
2026-03-28 11:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce11b67-18e3-52af-b042-c85f648a1906 with scrape type 2
2026-03-28 11:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fce11b67-18e3-52af-b042-c85f648a1906 with scrape type 2
2026-03-28 11:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fce11b67-18e3-52af-b042-c85f648a1906, identifier: TP66547
2026-03-28 11:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547
2026-03-28 11:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547
2026-03-28 11:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fce11b67-18e3-52af-b042-c85f648a1906 with identifier: TP66547 to the API
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:32:15Z',
 'fuel_type': 'diesel',
 'id': 'fce11b67-18e3-52af-b042-c85f648a1906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP66547',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Grandis',
 'odometer': 204619,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-04',
 'seller_name': None,
 'title': 'Mitsubishi Grandis 2.0 DI-D Intense',
 'transmission': 'manual',
 'trim': 'Intense',
 'year': 2008}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [auto1.de] INFO: Saving data for TP66547: {'auction_closing_time': 1774715535.0, 'created_time': 1773380910.472055, 'last_price_update_time': 1774695918.115407}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP66547') HTTP/1.1" 204 0
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [auto1.de] INFO: Scrape type for HY06483: 2
2026-03-28 11:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483
2026-03-28 11:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd79f322-cc4e-53e8-bf86-779b1ab3d404 with scrape type 2
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd79f322-cc4e-53e8-bf86-779b1ab3d404 with scrape type 2
2026-03-28 11:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd79f322-cc4e-53e8-bf86-779b1ab3d404, identifier: HY06483
2026-03-28 11:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483
2026-03-28 11:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483
2026-03-28 11:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd79f322-cc4e-53e8-bf86-779b1ab3d404 with identifier: HY06483 to the API
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:06:37Z',
 'fuel_type': 'petrol',
 'id': 'fd79f322-cc4e-53e8-bf86-779b1ab3d404',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY06483',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 194321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-13',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2006}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [auto1.de] INFO: Saving data for HY06483: {'auction_closing_time': 1774713997.0, 'created_time': 1773137885.530848, 'last_price_update_time': 1774695918.537209}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY06483') HTTP/1.1" 204 0
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: SJ46577
2026-03-28 11:05:18 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [auto1.de] INFO: Scrape type for HR97485: 2
2026-03-28 11:05:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485
2026-03-28 11:05:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb3055c5-de0b-5042-804a-6e47029758da with scrape type 2
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb3055c5-de0b-5042-804a-6e47029758da with scrape type 2
2026-03-28 11:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb3055c5-de0b-5042-804a-6e47029758da, identifier: HR97485
2026-03-28 11:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485
2026-03-28 11:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485
2026-03-28 11:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb3055c5-de0b-5042-804a-6e47029758da with identifier: HR97485 to the API
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:22:27Z',
 'fuel_type': 'petrol',
 'id': 'bb3055c5-de0b-5042-804a-6e47029758da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR97485',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 189513,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [auto1.de] INFO: Saving data for HR97485: {'auction_closing_time': 1774714947.0, 'created_time': 1774608171.667674, 'last_price_update_time': 1774695919.066763}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR97485') HTTP/1.1" 204 0
2026-03-28 11:05:19 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:19 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 9702 | hits on page: 40
2026-03-28 11:05:19 [auto1.de] INFO: Found listing with ID: VM88719
2026-03-28 11:05:19 [auto1.de] INFO: Found listing with ID: BB84550
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB84550%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [auto1.de] INFO: Scrape type for BB84550: 2
2026-03-28 11:05:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ee2ffb3-d991-522e-a064-81a9c082e71b with identifier: BB84550
2026-03-28 11:05:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ee2ffb3-d991-522e-a064-81a9c082e71b with scrape type 2
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ee2ffb3-d991-522e-a064-81a9c082e71b with scrape type 2
2026-03-28 11:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ee2ffb3-d991-522e-a064-81a9c082e71b, identifier: BB84550
2026-03-28 11:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ee2ffb3-d991-522e-a064-81a9c082e71b with identifier: BB84550
2026-03-28 11:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ee2ffb3-d991-522e-a064-81a9c082e71b with identifier: BB84550
2026-03-28 11:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ee2ffb3-d991-522e-a064-81a9c082e71b with identifier: BB84550 to the API
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:55Z',
 'fuel_type': 'petrol',
 'id': '6ee2ffb3-d991-522e-a064-81a9c082e71b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB84550',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 106866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-17',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB84550%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.de] INFO: Saving data for BB84550: {'auction_closing_time': 1774715215.0, 'created_time': 1774608155.165573, 'last_price_update_time': 1774695920.01937}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB84550') HTTP/1.1" 204 0
2026-03-28 11:05:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:20 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.de] INFO: Scrape type for BJ13428: 2
2026-03-28 11:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428
2026-03-28 11:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b with scrape type 2
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc47f720-0a2b-59f0-a249-ab17fbc46c7b with scrape type 2
2026-03-28 11:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc47f720-0a2b-59f0-a249-ab17fbc46c7b, identifier: BJ13428
2026-03-28 11:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428
2026-03-28 11:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428
2026-03-28 11:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc47f720-0a2b-59f0-a249-ab17fbc46c7b with identifier: BJ13428 to the API
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:15:42Z',
 'fuel_type': 'petrol',
 'id': 'dc47f720-0a2b-59f0-a249-ab17fbc46c7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ13428',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 96997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.de] INFO: Saving data for BJ13428: {'auction_closing_time': 1774714542.0, 'created_time': 1774608167.353307, 'last_price_update_time': 1774695920.511812}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ13428') HTTP/1.1" 204 0
2026-03-28 11:05:20 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [auto1.de] INFO: Scrape type for MY92722: 2
2026-03-28 11:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722
2026-03-28 11:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caa7f59e-3138-5b9a-b132-35704fa2c10d with scrape type 2
2026-03-28 11:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caa7f59e-3138-5b9a-b132-35704fa2c10d with scrape type 2
2026-03-28 11:05:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caa7f59e-3138-5b9a-b132-35704fa2c10d, identifier: MY92722
2026-03-28 11:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722
2026-03-28 11:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722
2026-03-28 11:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caa7f59e-3138-5b9a-b132-35704fa2c10d with identifier: MY92722 to the API
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:54:28Z',
 'fuel_type': 'diesel',
 'id': 'caa7f59e-3138-5b9a-b132-35704fa2c10d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY92722',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 223823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-09',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.de] INFO: Saving data for MY92722: {'auction_closing_time': 1774716868.0, 'created_time': 1774608191.339699, 'last_price_update_time': 1774695921.017907}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY92722') HTTP/1.1" 204 0
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: YV97613
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.de] INFO: Scrape type for ME89657: 2
2026-03-28 11:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657
2026-03-28 11:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a, identifier: ME89657
2026-03-28 11:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657
2026-03-28 11:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657
2026-03-28 11:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ca1e339-af0d-51ec-a9c0-bf60c09fb49a with identifier: ME89657 to the API
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:25:00Z',
 'fuel_type': 'diesel',
 'id': '4ca1e339-af0d-51ec-a9c0-bf60c09fb49a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME89657',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 84326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-08',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Control M',
 'transmission': 'manual',
 'trim': 'Control M',
 'year': 2019}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.de] INFO: Saving data for ME89657: {'auction_closing_time': 1774715100.0, 'created_time': 1774608164.120512, 'last_price_update_time': 1774695921.641487}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME89657') HTTP/1.1" 204 0
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-28 11:05:21 [auto1.de] INFO: Found listing with ID: ZC71941
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC71941%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [auto1.de] INFO: Scrape type for ZC71941: 2
2026-03-28 11:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with identifier: ZC71941
2026-03-28 11:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with scrape type 2
2026-03-28 11:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0, identifier: ZC71941
2026-03-28 11:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with identifier: ZC71941
2026-03-28 11:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with identifier: ZC71941
2026-03-28 11:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0 with identifier: ZC71941 to the API
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:45:18Z',
 'fuel_type': 'diesel',
 'id': 'd2a27ba6-3ad0-5ccd-bf67-c14f6ef94bf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC71941',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 174015,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-02',
 'seller_name': None,
 'title': 'BMW 5er 530d Edition Sport',
 'transmission': 'automatic',
 'trim': 'Edition Sport',
 'year': 2009}
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC71941%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.de] INFO: Saving data for ZC71941: {'auction_closing_time': 1774716318.0, 'created_time': 1774608169.874358, 'last_price_update_time': 1774695922.16512}
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC71941') HTTP/1.1" 204 0
2026-03-28 11:05:22 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-28 11:05:22 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.de] INFO: Scrape type for RC49554: 2
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca620246-94fc-52d2-85f0-43551625c43c with scrape type 2
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca620246-94fc-52d2-85f0-43551625c43c with scrape type 2
2026-03-28 11:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca620246-94fc-52d2-85f0-43551625c43c, identifier: RC49554
2026-03-28 11:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554
2026-03-28 11:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554
2026-03-28 11:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca620246-94fc-52d2-85f0-43551625c43c with identifier: RC49554 to the API
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:03:58Z',
 'fuel_type': 'petrol',
 'id': 'ca620246-94fc-52d2-85f0-43551625c43c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC49554',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 215543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2013}
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.de] INFO: Saving data for RC49554: {'auction_closing_time': 1774713838.0, 'created_time': 1774608181.587662, 'last_price_update_time': 1774695922.661432}
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC49554') HTTP/1.1" 204 0
2026-03-28 11:05:22 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [auto1.de] INFO: Scrape type for XG24427: 2
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa with scrape type 2
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3aea76f-6bbe-50f5-b2e0-c358667c15fa with scrape type 2
2026-03-28 11:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3aea76f-6bbe-50f5-b2e0-c358667c15fa, identifier: XG24427
2026-03-28 11:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427
2026-03-28 11:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427
2026-03-28 11:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3aea76f-6bbe-50f5-b2e0-c358667c15fa with identifier: XG24427 to the API
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:12:52Z',
 'fuel_type': 'diesel',
 'id': 'd3aea76f-6bbe-50f5-b2e0-c358667c15fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG24427',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 251784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-20',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.de] INFO: Saving data for XG24427: {'auction_closing_time': 1774714372.0, 'created_time': 1774608166.312778, 'last_price_update_time': 1774695923.229468}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG24427') HTTP/1.1" 204 0
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.de] INFO: Scrape type for RY74387: 2
2026-03-28 11:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387
2026-03-28 11:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f, identifier: RY74387
2026-03-28 11:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387
2026-03-28 11:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387
2026-03-28 11:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89cefb2c-9a32-56da-9cb2-dec0ee44e74f with identifier: RY74387 to the API
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:41:26Z',
 'fuel_type': 'petrol',
 'id': '89cefb2c-9a32-56da-9cb2-dec0ee44e74f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY74387',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 131453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-12',
 'seller_name': None,
 'title': 'Skoda Yeti 1.4 TSI Adventure',
 'transmission': 'automatic',
 'trim': 'Adventure',
 'year': 2014}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.de] INFO: Saving data for RY74387: {'auction_closing_time': 1774716086.0, 'created_time': 1774608172.975299, 'last_price_update_time': 1774695923.675924}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY74387') HTTP/1.1" 204 0
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: XK99060
2026-03-28 11:05:23 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [auto1.de] INFO: Scrape type for YG21382: 2
2026-03-28 11:05:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382
2026-03-28 11:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with scrape type 2
2026-03-28 11:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765, identifier: YG21382
2026-03-28 11:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382
2026-03-28 11:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382
2026-03-28 11:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 400fa082-25ab-5be2-b8ec-8ee3cb9ba765 with identifier: YG21382 to the API
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:39:12Z',
 'fuel_type': 'petrol',
 'id': '400fa082-25ab-5be2-b8ec-8ee3cb9ba765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG21382',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 69089,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS 245',
 'transmission': 'automatic',
 'trim': 'RS 245',
 'year': 2020}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.de] INFO: Saving data for YG21382: {'auction_closing_time': 1774715952.0, 'created_time': 1772726265.993264, 'last_price_update_time': 1774695924.169981}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG21382') HTTP/1.1" 204 0
2026-03-28 11:05:24 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.de] INFO: Scrape type for DY27021: 2
2026-03-28 11:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021
2026-03-28 11:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with scrape type 2
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with scrape type 2
2026-03-28 11:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9, identifier: DY27021
2026-03-28 11:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021
2026-03-28 11:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021
2026-03-28 11:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9 with identifier: DY27021 to the API
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:04:41Z',
 'fuel_type': 'petrol',
 'id': 'c9b1004f-a6c1-5d92-8ccb-e33b1f3dadc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY27021',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 93385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-13',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.de] INFO: Saving data for DY27021: {'auction_closing_time': 1774713881.0, 'created_time': 1774607848.818762, 'last_price_update_time': 1774695924.671295}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY27021') HTTP/1.1" 204 0
2026-03-28 11:05:24 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-28 11:05:24 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [auto1.de] INFO: Scrape type for RA54991: 2
2026-03-28 11:05:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991
2026-03-28 11:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd7697d-1a2c-541b-98f2-466444732b31 with scrape type 2
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fd7697d-1a2c-541b-98f2-466444732b31 with scrape type 2
2026-03-28 11:05:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fd7697d-1a2c-541b-98f2-466444732b31, identifier: RA54991
2026-03-28 11:05:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991
2026-03-28 11:05:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991
2026-03-28 11:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fd7697d-1a2c-541b-98f2-466444732b31 with identifier: RA54991 to the API
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:50:15Z',
 'fuel_type': 'petrol',
 'id': '7fd7697d-1a2c-541b-98f2-466444732b31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA54991',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 96079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-30',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [auto1.de] INFO: Saving data for RA54991: {'auction_closing_time': 1774716615.0, 'created_time': 1774607844.146742, 'last_price_update_time': 1774695925.138279}
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA54991') HTTP/1.1" 204 0
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: LA44092
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: GL18465
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL18465%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [auto1.de] INFO: Scrape type for GL18465: 2
2026-03-28 11:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5743c775-1541-5d96-ab2d-db07b572329d with identifier: GL18465
2026-03-28 11:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5743c775-1541-5d96-ab2d-db07b572329d with scrape type 2
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5743c775-1541-5d96-ab2d-db07b572329d with scrape type 2
2026-03-28 11:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5743c775-1541-5d96-ab2d-db07b572329d, identifier: GL18465
2026-03-28 11:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5743c775-1541-5d96-ab2d-db07b572329d with identifier: GL18465
2026-03-28 11:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5743c775-1541-5d96-ab2d-db07b572329d with identifier: GL18465
2026-03-28 11:05:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5743c775-1541-5d96-ab2d-db07b572329d with identifier: GL18465 to the API
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:09:12Z',
 'fuel_type': 'diesel',
 'id': '5743c775-1541-5d96-ab2d-db07b572329d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL18465',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 255387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-30',
 'seller_name': None,
 'title': 'Kia Sorento 2.5 CRDi EX',
 'transmission': 'automatic',
 'trim': 'EX',
 'year': 2003}
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL18465%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [auto1.de] INFO: Saving data for GL18465: {'auction_closing_time': 1774714152.0, 'created_time': 1774607869.279201, 'last_price_update_time': 1774695925.65801}
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL18465') HTTP/1.1" 204 0
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-28 11:05:25 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [auto1.de] INFO: Scrape type for PB35846: 2
2026-03-28 11:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846
2026-03-28 11:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with scrape type 2
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with scrape type 2
2026-03-28 11:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a, identifier: PB35846
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846
2026-03-28 11:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846
2026-03-28 11:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a with identifier: PB35846 to the API
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:39:44Z',
 'fuel_type': 'petrol',
 'id': '8fab0cb2-b31c-5b28-9d48-1f62ceb7ae5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB35846',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 104798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-27',
 'seller_name': None,
 'title': 'Seat Mii 1.0 FR-Line',
 'transmission': 'manual',
 'trim': 'FR-Line',
 'year': 2016}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-28 11:05:26 [auto1.de] INFO: Saving data for PB35846: {'auction_closing_time': 1774715984.0, 'created_time': 1774607868.888461, 'last_price_update_time': 1774695926.364044}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB35846') HTTP/1.1" 204 0
2026-03-28 11:05:26 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-28 11:05:26 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-28 11:05:26 [auto1.de] INFO: Found listing with ID: MV22283
2026-03-28 11:05:26 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-28 11:05:26 [auto1.de] INFO: Scrape type for LM85601: 2
2026-03-28 11:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601
2026-03-28 11:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7d60d65-98ae-59b3-9e5b-c52df001aa14 with scrape type 2
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7d60d65-98ae-59b3-9e5b-c52df001aa14 with scrape type 2
2026-03-28 11:05:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7d60d65-98ae-59b3-9e5b-c52df001aa14, identifier: LM85601
2026-03-28 11:05:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601
2026-03-28 11:05:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601
2026-03-28 11:05:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7d60d65-98ae-59b3-9e5b-c52df001aa14 with identifier: LM85601 to the API
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:24:52Z',
 'fuel_type': 'petrol',
 'id': 'b7d60d65-98ae-59b3-9e5b-c52df001aa14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM85601',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 214569,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-19',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2013}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-28 11:05:26 [auto1.de] INFO: Saving data for LM85601: {'auction_closing_time': 1774715092.0, 'created_time': 1774607908.521715, 'last_price_update_time': 1774695926.909834}
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM85601') HTTP/1.1" 204 0
2026-03-28 11:05:26 [auto1.de] INFO: Found listing with ID: WT41205
2026-03-28 11:05:26 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-28 11:05:26 [auto1.de] INFO: Scrape type for RM51665: 2
2026-03-28 11:05:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665
2026-03-28 11:05:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with scrape type 2
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with scrape type 2
2026-03-28 11:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc, identifier: RM51665
2026-03-28 11:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665
2026-03-28 11:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665
2026-03-28 11:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce4719aa-1a6b-5615-b1a4-d4cc0df408fc with identifier: RM51665 to the API
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:44:07Z',
 'fuel_type': 'diesel',
 'id': 'ce4719aa-1a6b-5615-b1a4-d4cc0df408fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM51665',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 223790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-25',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi DPF Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [auto1.de] INFO: Saving data for RM51665: {'auction_closing_time': 1774716247.0, 'created_time': 1774032379.989111, 'last_price_update_time': 1774695927.572241}
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM51665') HTTP/1.1" 204 0
2026-03-28 11:05:27 [auto1.de] INFO: Found listing with ID: DA44697
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA44697%27 HTTP/1.1" 200 None
2026-03-28 11:05:27 [auto1.de] INFO: Scrape type for DA44697: 2
2026-03-28 11:05:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01346f00-0669-5426-b2ed-c2a65de6f861 with identifier: DA44697
2026-03-28 11:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01346f00-0669-5426-b2ed-c2a65de6f861 with scrape type 2
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01346f00-0669-5426-b2ed-c2a65de6f861 with scrape type 2
2026-03-28 11:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01346f00-0669-5426-b2ed-c2a65de6f861, identifier: DA44697
2026-03-28 11:05:27 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 9702 | hits on page: 40
2026-03-28 11:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01346f00-0669-5426-b2ed-c2a65de6f861 with identifier: DA44697
2026-03-28 11:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01346f00-0669-5426-b2ed-c2a65de6f861 with identifier: DA44697
2026-03-28 11:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01346f00-0669-5426-b2ed-c2a65de6f861 with identifier: DA44697 to the API
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:20:35Z',
 'fuel_type': 'diesel',
 'id': '01346f00-0669-5426-b2ed-c2a65de6f861',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA44697',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 266392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-31',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2008}
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA44697%27 HTTP/1.1" 200 None
2026-03-28 11:05:28 [auto1.de] INFO: Saving data for DA44697: {'auction_closing_time': 1774714835.0, 'created_time': 1774608084.370593, 'last_price_update_time': 1774695928.35881}
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA44697') HTTP/1.1" 204 0
2026-03-28 11:05:28 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-28 11:05:28 [auto1.de] INFO: Scrape type for NL59666: 2
2026-03-28 11:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-03-28 11:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4466ed50-5955-5583-a8aa-05d304311dea with scrape type 2
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4466ed50-5955-5583-a8aa-05d304311dea with scrape type 2
2026-03-28 11:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4466ed50-5955-5583-a8aa-05d304311dea, identifier: NL59666
2026-03-28 11:05:28 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-28 11:05:28 [auto1.de] INFO: Scrape type for RE53759: 2
2026-03-28 11:05:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759
2026-03-28 11:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a6067b-ee3b-5610-a804-62b31a689d9b with scrape type 2
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8a6067b-ee3b-5610-a804-62b31a689d9b with scrape type 2
2026-03-28 11:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8a6067b-ee3b-5610-a804-62b31a689d9b, identifier: RE53759
2026-03-28 11:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-03-28 11:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666
2026-03-28 11:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4466ed50-5955-5583-a8aa-05d304311dea with identifier: NL59666 to the API
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:24:03Z',
 'fuel_type': 'diesel',
 'id': '4466ed50-5955-5583-a8aa-05d304311dea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL59666',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 286049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-08',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Design',
 'transmission': 'automatic',
 'trim': 'Design',
 'year': 2016}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-28 11:05:29 [auto1.de] INFO: Saving data for NL59666: {'auction_closing_time': 1774715043.0, 'created_time': 1774608195.746186, 'last_price_update_time': 1774695929.115088}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL59666') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759
2026-03-28 11:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759
2026-03-28 11:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8a6067b-ee3b-5610-a804-62b31a689d9b with identifier: RE53759 to the API
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:56:17Z',
 'fuel_type': 'petrol',
 'id': 'b8a6067b-ee3b-5610-a804-62b31a689d9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE53759',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 128859,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-05',
 'seller_name': None,
 'title': 'Opel Insignia 2.8 V6 Turbo OPC 4x4',
 'transmission': 'manual',
 'trim': 'OPC 4x4',
 'year': 2011}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-28 11:05:29 [auto1.de] INFO: Saving data for RE53759: {'auction_closing_time': 1774716977.0, 'created_time': 1773945758.684726, 'last_price_update_time': 1774695929.706561}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE53759') HTTP/1.1" 204 0
2026-03-28 11:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-28 11:05:29 [auto1.de] INFO: Scrape type for MN72943: 2
2026-03-28 11:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943
2026-03-28 11:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40caefae-b0d8-54bc-93cb-207ca0940897 with scrape type 2
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40caefae-b0d8-54bc-93cb-207ca0940897 with scrape type 2
2026-03-28 11:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40caefae-b0d8-54bc-93cb-207ca0940897, identifier: MN72943
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-28 11:05:29 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-28 11:05:29 [auto1.de] INFO: Scrape type for ZW99084: 2
2026-03-28 11:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084
2026-03-28 11:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with scrape type 2
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with scrape type 2
2026-03-28 11:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b, identifier: ZW99084
2026-03-28 11:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943
2026-03-28 11:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943
2026-03-28 11:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40caefae-b0d8-54bc-93cb-207ca0940897 with identifier: MN72943 to the API
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:51:28Z',
 'fuel_type': 'petrol',
 'id': '40caefae-b0d8-54bc-93cb-207ca0940897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN72943',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 126257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-01',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [auto1.de] INFO: Saving data for MN72943: {'auction_closing_time': 1774716688.0, 'created_time': 1774607848.116328, 'last_price_update_time': 1774695930.301549}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN72943') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084
2026-03-28 11:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084
2026-03-28 11:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1cb2c7a-2cf2-5d04-9bb0-faa016272f2b with identifier: ZW99084 to the API
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:05Z',
 'fuel_type': 'diesel',
 'id': 'd1cb2c7a-2cf2-5d04-9bb0-faa016272f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW99084',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 195256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-02',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [auto1.de] INFO: Saving data for ZW99084: {'auction_closing_time': 1774714745.0, 'created_time': 1774034285.469778, 'last_price_update_time': 1774695930.618354}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW99084') HTTP/1.1" 204 0
2026-03-28 11:05:30 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-28 11:05:30 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-28 11:05:30 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-28 11:05:30 [auto1.de] INFO: Found listing with ID: NL50541
2026-03-28 11:05:30 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-28 11:05:30 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [auto1.de] INFO: Scrape type for RK12981: 2
2026-03-28 11:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981
2026-03-28 11:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with scrape type 2
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with scrape type 2
2026-03-28 11:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33, identifier: RK12981
2026-03-28 11:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981
2026-03-28 11:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981
2026-03-28 11:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac52cc4a-fe0a-50d3-9738-c9adc27c3b33 with identifier: RK12981 to the API
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:51:01Z',
 'fuel_type': 'petrol',
 'id': 'ac52cc4a-fe0a-50d3-9738-c9adc27c3b33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK12981',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 132872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-28 11:05:31 [auto1.de] INFO: Saving data for RK12981: {'auction_closing_time': 1774716661.0, 'created_time': 1773345944.381472, 'last_price_update_time': 1774695931.334743}
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK12981') HTTP/1.1" 204 0
2026-03-28 11:05:31 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-28 11:05:31 [auto1.de] INFO: Scrape type for SM28331: 2
2026-03-28 11:05:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331
2026-03-28 11:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 606c995a-e7d7-51fa-81a9-153413786cc6 with scrape type 2
2026-03-28 11:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 606c995a-e7d7-51fa-81a9-153413786cc6 with scrape type 2
2026-03-28 11:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 606c995a-e7d7-51fa-81a9-153413786cc6, identifier: SM28331
2026-03-28 11:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331
2026-03-28 11:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331
2026-03-28 11:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 606c995a-e7d7-51fa-81a9-153413786cc6 with identifier: SM28331 to the API
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:32:23Z',
 'fuel_type': 'diesel',
 'id': '606c995a-e7d7-51fa-81a9-153413786cc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM28331',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 134592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-14',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [auto1.de] INFO: Saving data for SM28331: {'auction_closing_time': 1774715543.0, 'created_time': 1774607843.283709, 'last_price_update_time': 1774695932.17003}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM28331') HTTP/1.1" 204 0
2026-03-28 11:05:32 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [auto1.de] INFO: Scrape type for PP43066: 2
2026-03-28 11:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066
2026-03-28 11:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2239d488-0849-58ee-a1e7-739c9b060fb4 with scrape type 2
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2239d488-0849-58ee-a1e7-739c9b060fb4 with scrape type 2
2026-03-28 11:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2239d488-0849-58ee-a1e7-739c9b060fb4, identifier: PP43066
2026-03-28 11:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066
2026-03-28 11:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066
2026-03-28 11:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2239d488-0849-58ee-a1e7-739c9b060fb4 with identifier: PP43066 to the API
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:05:07Z',
 'fuel_type': 'diesel',
 'id': '2239d488-0849-58ee-a1e7-739c9b060fb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP43066',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 262535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2016}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [auto1.de] INFO: Saving data for PP43066: {'auction_closing_time': 1774713907.0, 'created_time': 1774608097.238384, 'last_price_update_time': 1774695932.884977}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP43066') HTTP/1.1" 204 0
2026-03-28 11:05:32 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-28 11:05:32 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [auto1.de] INFO: Scrape type for DJ93554: 2
2026-03-28 11:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554
2026-03-28 11:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with scrape type 2
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with scrape type 2
2026-03-28 11:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45bfcb05-cc85-56f2-95b4-9652f8e5b570, identifier: DJ93554
2026-03-28 11:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554
2026-03-28 11:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554
2026-03-28 11:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45bfcb05-cc85-56f2-95b4-9652f8e5b570 with identifier: DJ93554 to the API
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:21:57Z',
 'fuel_type': 'petrol',
 'id': '45bfcb05-cc85-56f2-95b4-9652f8e5b570',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ93554',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 40873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-28',
 'seller_name': None,
 'title': 'Audi A4 40 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [auto1.de] INFO: Saving data for DJ93554: {'auction_closing_time': 1774714917.0, 'created_time': 1774607910.329623, 'last_price_update_time': 1774695933.312533}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ93554') HTTP/1.1" 204 0
2026-03-28 11:05:33 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-28 11:05:33 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [auto1.de] INFO: Scrape type for CZ73559: 2
2026-03-28 11:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559
2026-03-28 11:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with scrape type 2
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with scrape type 2
2026-03-28 11:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e, identifier: CZ73559
2026-03-28 11:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559
2026-03-28 11:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559
2026-03-28 11:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e with identifier: CZ73559 to the API
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:45Z',
 'fuel_type': 'diesel',
 'id': '5f0351c7-51d4-54ac-9a6e-6110c5b4fd9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ73559',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 14683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2025}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [auto1.de] INFO: Saving data for CZ73559: {'auction_closing_time': 1774716945.0, 'created_time': 1774034874.647783, 'last_price_update_time': 1774695933.752967}
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ73559') HTTP/1.1" 204 0
2026-03-28 11:05:33 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-28 11:05:33 [auto1.de] INFO: Scrape type for SP41921: 2
2026-03-28 11:05:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921
2026-03-28 11:05:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c5914a-085d-5791-ad81-66cf3b603e11 with scrape type 2
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55c5914a-085d-5791-ad81-66cf3b603e11 with scrape type 2
2026-03-28 11:05:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55c5914a-085d-5791-ad81-66cf3b603e11, identifier: SP41921
2026-03-28 11:05:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921
2026-03-28 11:05:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921
2026-03-28 11:05:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55c5914a-085d-5791-ad81-66cf3b603e11 with identifier: SP41921 to the API
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:53:10Z',
 'fuel_type': 'diesel',
 'id': '55c5914a-085d-5791-ad81-66cf3b603e11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP41921',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 178506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-05',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [auto1.de] INFO: Saving data for SP41921: {'auction_closing_time': 1774716790.0, 'created_time': 1774608039.338563, 'last_price_update_time': 1774695935.217648}
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP41921') HTTP/1.1" 204 0
2026-03-28 11:05:35 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [auto1.de] INFO: Scrape type for KP48554: 2
2026-03-28 11:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554
2026-03-28 11:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with scrape type 2
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with scrape type 2
2026-03-28 11:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6, identifier: KP48554
2026-03-28 11:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554
2026-03-28 11:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554
2026-03-28 11:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6 with identifier: KP48554 to the API
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:37Z',
 'fuel_type': 'diesel',
 'id': '50cfbc2e-b949-5cf5-9f6e-8f63a316cfc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP48554',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 201949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-27',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [auto1.de] INFO: Saving data for KP48554: {'auction_closing_time': 1774716637.0, 'created_time': 1774607891.335144, 'last_price_update_time': 1774695935.662025}
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP48554') HTTP/1.1" 204 0
2026-03-28 11:05:35 [auto1.de] INFO: Found listing with ID: VX15127
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15127%27 HTTP/1.1" 200 None
2026-03-28 11:05:35 [auto1.de] INFO: Scrape type for VX15127: 2
2026-03-28 11:05:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2280100b-b82e-55b6-8e4f-5653c06cdb3b with identifier: VX15127
2026-03-28 11:05:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b with scrape type 2
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2280100b-b82e-55b6-8e4f-5653c06cdb3b with scrape type 2
2026-03-28 11:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2280100b-b82e-55b6-8e4f-5653c06cdb3b, identifier: VX15127
2026-03-28 11:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2280100b-b82e-55b6-8e4f-5653c06cdb3b with identifier: VX15127
2026-03-28 11:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2280100b-b82e-55b6-8e4f-5653c06cdb3b with identifier: VX15127
2026-03-28 11:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2280100b-b82e-55b6-8e4f-5653c06cdb3b with identifier: VX15127 to the API
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:40Z',
 'fuel_type': 'petrol',
 'id': '2280100b-b82e-55b6-8e4f-5653c06cdb3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX15127',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 116249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-08',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Mild-Hybrid Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2020}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15127%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [auto1.de] INFO: Saving data for VX15127: {'auction_closing_time': 1774715260.0, 'created_time': 1774607906.992446, 'last_price_update_time': 1774695936.141315}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX15127') HTTP/1.1" 204 0
2026-03-28 11:05:36 [auto1.de] INFO: Found listing with ID: RS38976
2026-03-28 11:05:36 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [auto1.de] INFO: Scrape type for XN16480: 2
2026-03-28 11:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480
2026-03-28 11:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04305936-6e41-50fa-9e9f-7d21f1db7b3d with scrape type 2
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04305936-6e41-50fa-9e9f-7d21f1db7b3d with scrape type 2
2026-03-28 11:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04305936-6e41-50fa-9e9f-7d21f1db7b3d, identifier: XN16480
2026-03-28 11:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480
2026-03-28 11:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480
2026-03-28 11:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04305936-6e41-50fa-9e9f-7d21f1db7b3d with identifier: XN16480 to the API
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:35:10Z',
 'fuel_type': 'petrol',
 'id': '04305936-6e41-50fa-9e9f-7d21f1db7b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN16480',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 169882,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [auto1.de] INFO: Saving data for XN16480: {'auction_closing_time': 1774715710.0, 'created_time': 1774350519.263454, 'last_price_update_time': 1774695936.595184}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN16480') HTTP/1.1" 204 0
2026-03-28 11:05:36 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [auto1.de] INFO: Scrape type for YT12990: 2
2026-03-28 11:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990
2026-03-28 11:05:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33b090c3-7679-5d79-9827-15456f1a02ca with scrape type 2
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33b090c3-7679-5d79-9827-15456f1a02ca with scrape type 2
2026-03-28 11:05:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33b090c3-7679-5d79-9827-15456f1a02ca, identifier: YT12990
2026-03-28 11:05:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990
2026-03-28 11:05:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990
2026-03-28 11:05:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33b090c3-7679-5d79-9827-15456f1a02ca with identifier: YT12990 to the API
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:36:18Z',
 'fuel_type': 'petrol',
 'id': '33b090c3-7679-5d79-9827-15456f1a02ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT12990',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 67771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-31',
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [auto1.de] INFO: Saving data for YT12990: {'auction_closing_time': 1774715778.0, 'created_time': 1774608094.754815, 'last_price_update_time': 1774695937.043305}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT12990') HTTP/1.1" 204 0
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [auto1.de] INFO: Scrape type for ZE79625: 2
2026-03-28 11:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625
2026-03-28 11:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5356c6df-c266-58d6-827d-f52dbfdd28a3 with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5356c6df-c266-58d6-827d-f52dbfdd28a3 with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5356c6df-c266-58d6-827d-f52dbfdd28a3, identifier: ZE79625
2026-03-28 11:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625
2026-03-28 11:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625
2026-03-28 11:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5356c6df-c266-58d6-827d-f52dbfdd28a3 with identifier: ZE79625 to the API
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:28:37Z',
 'fuel_type': 'petrol',
 'id': '5356c6df-c266-58d6-827d-f52dbfdd28a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE79625',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 113996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-10',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis Prime',
 'transmission': 'manual',
 'trim': 'Basis Prime',
 'year': 2015}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [auto1.de] INFO: Saving data for ZE79625: {'auction_closing_time': 1774715317.0, 'created_time': 1774607903.553274, 'last_price_update_time': 1774695937.555601}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE79625') HTTP/1.1" 204 0
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: VW35628
2026-03-28 11:05:37 [auto1.de] INFO: Found listing with ID: DE80885
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE80885%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [auto1.de] INFO: Scrape type for DE80885: 2
2026-03-28 11:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c478098-0899-5054-bb41-5eed6243400e with identifier: DE80885
2026-03-28 11:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c478098-0899-5054-bb41-5eed6243400e with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c478098-0899-5054-bb41-5eed6243400e with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c478098-0899-5054-bb41-5eed6243400e, identifier: DE80885
2026-03-28 11:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c478098-0899-5054-bb41-5eed6243400e with identifier: DE80885
2026-03-28 11:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c478098-0899-5054-bb41-5eed6243400e with identifier: DE80885
2026-03-28 11:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c478098-0899-5054-bb41-5eed6243400e with identifier: DE80885 to the API
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:34:34Z',
 'fuel_type': 'petrol',
 'id': '5c478098-0899-5054-bb41-5eed6243400e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE80885',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 121463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-26',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2013}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE80885%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Saving data for DE80885: {'auction_closing_time': 1774715674.0, 'created_time': 1774607867.8939, 'last_price_update_time': 1774695938.029522}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE80885') HTTP/1.1" 204 0
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Scrape type for JX17185: 2
2026-03-28 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185
2026-03-28 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef360b7-994a-5ac5-bf57-42ec01862ff9 with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bef360b7-994a-5ac5-bf57-42ec01862ff9 with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bef360b7-994a-5ac5-bf57-42ec01862ff9, identifier: JX17185
2026-03-28 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185
2026-03-28 11:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185
2026-03-28 11:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bef360b7-994a-5ac5-bf57-42ec01862ff9 with identifier: JX17185 to the API
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:13:01Z',
 'fuel_type': 'petrol',
 'id': 'bef360b7-994a-5ac5-bf57-42ec01862ff9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX17185',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 24281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-20',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Saving data for JX17185: {'auction_closing_time': 1774714381.0, 'created_time': 1774607849.46068, 'last_price_update_time': 1774695938.45843}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX17185') HTTP/1.1" 204 0
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: LR18629
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: XS57001
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS57001%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Scrape type for XS57001: 2
2026-03-28 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbdce216-66a7-56d0-9e96-bc377b3ac056 with identifier: XS57001
2026-03-28 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbdce216-66a7-56d0-9e96-bc377b3ac056 with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbdce216-66a7-56d0-9e96-bc377b3ac056 with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbdce216-66a7-56d0-9e96-bc377b3ac056, identifier: XS57001
2026-03-28 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbdce216-66a7-56d0-9e96-bc377b3ac056 with identifier: XS57001
2026-03-28 11:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbdce216-66a7-56d0-9e96-bc377b3ac056 with identifier: XS57001
2026-03-28 11:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbdce216-66a7-56d0-9e96-bc377b3ac056 with identifier: XS57001 to the API
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:05:13Z',
 'fuel_type': 'petrol',
 'id': 'fbdce216-66a7-56d0-9e96-bc377b3ac056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS57001',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 107951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-02-19',
 'seller_name': None,
 'title': 'BMW 3er 318Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS57001%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Saving data for XS57001: {'auction_closing_time': 1774713913.0, 'created_time': 1774607866.245284, 'last_price_update_time': 1774695938.906869}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS57001') HTTP/1.1" 204 0
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-28 11:05:38 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [auto1.de] INFO: Scrape type for SW83321: 2
2026-03-28 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321
2026-03-28 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9235e0f5-7147-52b3-8aac-80edc826c31e with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9235e0f5-7147-52b3-8aac-80edc826c31e with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9235e0f5-7147-52b3-8aac-80edc826c31e, identifier: SW83321
2026-03-28 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321
2026-03-28 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321
2026-03-28 11:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9235e0f5-7147-52b3-8aac-80edc826c31e with identifier: SW83321 to the API
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:48:40Z',
 'fuel_type': 'diesel',
 'id': '9235e0f5-7147-52b3-8aac-80edc826c31e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW83321',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 73295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-02',
 'seller_name': None,
 'title': 'Seat Arona 1.6 TDI Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2020}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [auto1.de] INFO: Saving data for SW83321: {'auction_closing_time': 1774716520.0, 'created_time': 1774034297.768809, 'last_price_update_time': 1774695939.37665}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW83321') HTTP/1.1" 204 0
2026-03-28 11:05:39 [auto1.de] INFO: Found listing with ID: PA36365
2026-03-28 11:05:39 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [auto1.de] INFO: Scrape type for MC36419: 2
2026-03-28 11:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419
2026-03-28 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eabbf226-ded2-5c83-955d-c86e7083f3ed with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eabbf226-ded2-5c83-955d-c86e7083f3ed with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eabbf226-ded2-5c83-955d-c86e7083f3ed, identifier: MC36419
2026-03-28 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419
2026-03-28 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419
2026-03-28 11:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eabbf226-ded2-5c83-955d-c86e7083f3ed with identifier: MC36419 to the API
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:41:54Z',
 'fuel_type': 'petrol',
 'id': 'eabbf226-ded2-5c83-955d-c86e7083f3ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC36419',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 112532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-23',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2014}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [auto1.de] INFO: Saving data for MC36419: {'auction_closing_time': 1774716114.0, 'created_time': 1773945772.116049, 'last_price_update_time': 1774695939.914055}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC36419') HTTP/1.1" 204 0
2026-03-28 11:05:39 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 9702 | hits on page: 40
2026-03-28 11:05:39 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-28 11:05:39 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [auto1.de] INFO: Scrape type for FZ80305: 2
2026-03-28 11:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305
2026-03-28 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with scrape type 2
2026-03-28 11:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2, identifier: FZ80305
2026-03-28 11:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305
2026-03-28 11:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305
2026-03-28 11:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2 with identifier: FZ80305 to the API
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:20:16Z',
 'fuel_type': 'petrol',
 'id': 'cdb9bb85-b1cd-51ec-b3f4-acfb0dc769a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ80305',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 170018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-08',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-28 11:05:40 [auto1.de] INFO: Saving data for FZ80305: {'auction_closing_time': 1774714816.0, 'created_time': 1773381718.379825, 'last_price_update_time': 1774695940.660072}
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ80305') HTTP/1.1" 204 0
2026-03-28 11:05:40 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-28 11:05:40 [auto1.de] INFO: Scrape type for YY13521: 2
2026-03-28 11:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521
2026-03-28 11:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with scrape type 2
2026-03-28 11:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with scrape type 2
2026-03-28 11:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d90399d-4d6a-5ce4-9639-e6435a8cb023, identifier: YY13521
2026-03-28 11:05:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:40 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-28 11:05:40 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-28 11:05:40 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-28 11:05:40 [auto1.de] INFO: Scrape type for FR95379: 2
2026-03-28 11:05:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379
2026-03-28 11:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with scrape type 2
2026-03-28 11:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with scrape type 2
2026-03-28 11:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a, identifier: FR95379
2026-03-28 11:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521
2026-03-28 11:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521
2026-03-28 11:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d90399d-4d6a-5ce4-9639-e6435a8cb023 with identifier: YY13521 to the API
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:49:48Z',
 'fuel_type': 'diesel',
 'id': '8d90399d-4d6a-5ce4-9639-e6435a8cb023',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY13521',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 169283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-01',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 CRDi Go-Plus 4WD',
 'transmission': 'automatic',
 'trim': 'Go-Plus 4WD',
 'year': 2014}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [auto1.de] INFO: Saving data for YY13521: {'auction_closing_time': 1774716588.0, 'created_time': 1774607892.469515, 'last_price_update_time': 1774695941.475454}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY13521') HTTP/1.1" 204 0
2026-03-28 11:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379
2026-03-28 11:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379
2026-03-28 11:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff2c81ee-9d17-52bc-8cfd-2ab00979e48a with identifier: FR95379 to the API
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:03:35Z',
 'fuel_type': 'diesel',
 'id': 'ff2c81ee-9d17-52bc-8cfd-2ab00979e48a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR95379',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 255205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-31',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 e-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2013}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [auto1.de] INFO: Saving data for FR95379: {'auction_closing_time': 1774713815.0, 'created_time': 1774607871.525974, 'last_price_update_time': 1774695941.917141}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR95379') HTTP/1.1" 204 0
2026-03-28 11:05:41 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [auto1.de] INFO: Scrape type for RU59623: 2
2026-03-28 11:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623
2026-03-28 11:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd8496aa-ce74-5fca-b528-3e32ab32a063 with scrape type 2
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd8496aa-ce74-5fca-b528-3e32ab32a063 with scrape type 2
2026-03-28 11:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd8496aa-ce74-5fca-b528-3e32ab32a063, identifier: RU59623
2026-03-28 11:05:42 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [auto1.de] INFO: Scrape type for VZ15565: 2
2026-03-28 11:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565
2026-03-28 11:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with scrape type 2
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with scrape type 2
2026-03-28 11:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab, identifier: VZ15565
2026-03-28 11:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623
2026-03-28 11:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623
2026-03-28 11:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd8496aa-ce74-5fca-b528-3e32ab32a063 with identifier: RU59623 to the API
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:48Z',
 'fuel_type': 'diesel',
 'id': 'fd8496aa-ce74-5fca-b528-3e32ab32a063',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU59623',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 249799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-16',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [auto1.de] INFO: Saving data for RU59623: {'auction_closing_time': 1774715268.0, 'created_time': 1774608056.658455, 'last_price_update_time': 1774695942.51328}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU59623') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565
2026-03-28 11:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565
2026-03-28 11:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab with identifier: VZ15565 to the API
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:36:12Z',
 'fuel_type': 'petrol',
 'id': 'abfaa33e-cdb2-5b4c-b3a0-041fd6fceaab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ15565',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 135645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-09',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Style Viva',
 'transmission': 'manual',
 'trim': 'Style Viva',
 'year': 2012}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [auto1.de] INFO: Saving data for VZ15565: {'auction_closing_time': 1774715772.0, 'created_time': 1774607966.13937, 'last_price_update_time': 1774695942.852308}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ15565') HTTP/1.1" 204 0
2026-03-28 11:05:42 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [auto1.de] INFO: Scrape type for JK60563: 2
2026-03-28 11:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563
2026-03-28 11:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7ece84-c851-5581-8502-9c5f6d8034b5 with scrape type 2
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7ece84-c851-5581-8502-9c5f6d8034b5 with scrape type 2
2026-03-28 11:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f7ece84-c851-5581-8502-9c5f6d8034b5, identifier: JK60563
2026-03-28 11:05:42 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-28 11:05:42 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [auto1.de] INFO: Scrape type for PU37095: 2
2026-03-28 11:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095
2026-03-28 11:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90434af9-4655-5121-a7a0-1bd4e25b93e5 with scrape type 2
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90434af9-4655-5121-a7a0-1bd4e25b93e5 with scrape type 2
2026-03-28 11:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90434af9-4655-5121-a7a0-1bd4e25b93e5, identifier: PU37095
2026-03-28 11:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563
2026-03-28 11:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563
2026-03-28 11:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f7ece84-c851-5581-8502-9c5f6d8034b5 with identifier: JK60563 to the API
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:20:24Z',
 'fuel_type': 'diesel',
 'id': '7f7ece84-c851-5581-8502-9c5f6d8034b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK60563',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 106259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [auto1.de] INFO: Saving data for JK60563: {'auction_closing_time': 1774714824.0, 'created_time': 1773226319.30361, 'last_price_update_time': 1774695943.40467}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK60563') HTTP/1.1" 204 0
2026-03-28 11:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095
2026-03-28 11:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095
2026-03-28 11:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90434af9-4655-5121-a7a0-1bd4e25b93e5 with identifier: PU37095 to the API
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:02:48Z',
 'fuel_type': 'petrol',
 'id': '90434af9-4655-5121-a7a0-1bd4e25b93e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU37095',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 61329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-27',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2015}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [auto1.de] INFO: Saving data for PU37095: {'auction_closing_time': 1774713768.0, 'created_time': 1774607870.876091, 'last_price_update_time': 1774695943.870658}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU37095') HTTP/1.1" 204 0
2026-03-28 11:05:43 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [auto1.de] INFO: Scrape type for ZU18943: 2
2026-03-28 11:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943
2026-03-28 11:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36bc4754-36b5-5669-815e-2f90396e29c3 with scrape type 2
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36bc4754-36b5-5669-815e-2f90396e29c3 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36bc4754-36b5-5669-815e-2f90396e29c3, identifier: ZU18943
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.de] INFO: Scrape type for LF81800: 2
2026-03-28 11:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800
2026-03-28 11:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f537fabd-01eb-5925-9c49-4eeb5f2847d0 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f537fabd-01eb-5925-9c49-4eeb5f2847d0 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f537fabd-01eb-5925-9c49-4eeb5f2847d0, identifier: LF81800
2026-03-28 11:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943
2026-03-28 11:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943
2026-03-28 11:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36bc4754-36b5-5669-815e-2f90396e29c3 with identifier: ZU18943 to the API
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:45:51Z',
 'fuel_type': 'petrol',
 'id': '36bc4754-36b5-5669-815e-2f90396e29c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU18943',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 28590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-04',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.de] INFO: Saving data for ZU18943: {'auction_closing_time': 1774716351.0, 'created_time': 1774607992.887277, 'last_price_update_time': 1774695944.413112}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU18943') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800
2026-03-28 11:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800
2026-03-28 11:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f537fabd-01eb-5925-9c49-4eeb5f2847d0 with identifier: LF81800 to the API
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:09:21Z',
 'fuel_type': 'diesel',
 'id': 'f537fabd-01eb-5925-9c49-4eeb5f2847d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF81800',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 51374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-02',
 'seller_name': None,
 'title': 'Opel Vivaro 1.5 CDTI M Edition L2',
 'transmission': 'manual',
 'trim': 'M Edition L2',
 'year': 2024}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.de] INFO: Saving data for LF81800: {'auction_closing_time': 1774714161.0, 'created_time': 1773946473.89168, 'last_price_update_time': 1774695944.744191}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF81800') HTTP/1.1" 204 0
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: HB67521
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.de] INFO: Scrape type for FS32666: 2
2026-03-28 11:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666
2026-03-28 11:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2dd30a2-4a92-594f-abd0-554146a32812 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2dd30a2-4a92-594f-abd0-554146a32812 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2dd30a2-4a92-594f-abd0-554146a32812, identifier: FS32666
2026-03-28 11:05:44 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [auto1.de] INFO: Scrape type for BP33481: 2
2026-03-28 11:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481
2026-03-28 11:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with scrape type 2
2026-03-28 11:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bb0099a-3b0d-50f1-ba1b-750944f050f9, identifier: BP33481
2026-03-28 11:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666
2026-03-28 11:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666
2026-03-28 11:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2dd30a2-4a92-594f-abd0-554146a32812 with identifier: FS32666 to the API
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:07:40Z',
 'fuel_type': 'petrol',
 'id': 'a2dd30a2-4a92-594f-abd0-554146a32812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS32666',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 88669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-16',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Urban Explorer 4x2',
 'transmission': 'manual',
 'trim': 'Urban Explorer 4x2',
 'year': 2015}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [auto1.de] INFO: Saving data for FS32666: {'auction_closing_time': 1774714060.0, 'created_time': 1774607861.316366, 'last_price_update_time': 1774695945.293515}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS32666') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481
2026-03-28 11:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481
2026-03-28 11:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bb0099a-3b0d-50f1-ba1b-750944f050f9 with identifier: BP33481 to the API
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:36Z',
 'fuel_type': 'petrol',
 'id': '0bb0099a-3b0d-50f1-ba1b-750944f050f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP33481',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 257051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-13',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2013}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [auto1.de] INFO: Saving data for BP33481: {'auction_closing_time': 1774716996.0, 'created_time': 1774607863.392483, 'last_price_update_time': 1774695945.608237}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP33481') HTTP/1.1" 204 0
2026-03-28 11:05:45 [auto1.de] INFO: Found listing with ID: ZN32695
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN32695%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [auto1.de] INFO: Scrape type for ZN32695: 2
2026-03-28 11:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with identifier: ZN32695
2026-03-28 11:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with scrape type 2
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with scrape type 2
2026-03-28 11:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f48a2e84-9136-5ddf-8c5b-928cf3e867f1, identifier: ZN32695
2026-03-28 11:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with identifier: ZN32695
2026-03-28 11:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with identifier: ZN32695
2026-03-28 11:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f48a2e84-9136-5ddf-8c5b-928cf3e867f1 with identifier: ZN32695 to the API
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:44Z',
 'fuel_type': 'petrol',
 'id': 'f48a2e84-9136-5ddf-8c5b-928cf3e867f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN32695',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 167579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Lounge BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN32695%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.de] INFO: Saving data for ZN32695: {'auction_closing_time': 1774714664.0, 'created_time': 1774607866.665239, 'last_price_update_time': 1774695946.131682}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN32695') HTTP/1.1" 204 0
2026-03-28 11:05:46 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-28 11:05:46 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.de] INFO: Scrape type for MR34714: 2
2026-03-28 11:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714
2026-03-28 11:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea3d14a-19a8-56c3-b23d-aec013038f1c with scrape type 2
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ea3d14a-19a8-56c3-b23d-aec013038f1c with scrape type 2
2026-03-28 11:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ea3d14a-19a8-56c3-b23d-aec013038f1c, identifier: MR34714
2026-03-28 11:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714
2026-03-28 11:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714
2026-03-28 11:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ea3d14a-19a8-56c3-b23d-aec013038f1c with identifier: MR34714 to the API
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:51:45Z',
 'fuel_type': 'petrol',
 'id': '6ea3d14a-19a8-56c3-b23d-aec013038f1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR34714',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 97256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2005}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.de] INFO: Saving data for MR34714: {'auction_closing_time': 1774716705.0, 'created_time': 1774033519.700841, 'last_price_update_time': 1774695946.673529}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR34714') HTTP/1.1" 204 0
2026-03-28 11:05:46 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-28 11:05:46 [auto1.de] INFO: Found listing with ID: MK03700
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK03700%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [auto1.de] INFO: Scrape type for MK03700: 2
2026-03-28 11:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6d515cc-b349-51af-8401-a6d8f0ed83fd with identifier: MK03700
2026-03-28 11:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6d515cc-b349-51af-8401-a6d8f0ed83fd with scrape type 2
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6d515cc-b349-51af-8401-a6d8f0ed83fd with scrape type 2
2026-03-28 11:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6d515cc-b349-51af-8401-a6d8f0ed83fd, identifier: MK03700
2026-03-28 11:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6d515cc-b349-51af-8401-a6d8f0ed83fd with identifier: MK03700
2026-03-28 11:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6d515cc-b349-51af-8401-a6d8f0ed83fd with identifier: MK03700
2026-03-28 11:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6d515cc-b349-51af-8401-a6d8f0ed83fd with identifier: MK03700 to the API
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:01:25Z',
 'fuel_type': 'petrol',
 'id': 'c6d515cc-b349-51af-8401-a6d8f0ed83fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK03700',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 133985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-04',
 'seller_name': None,
 'title': 'Renault Kangoo 1.2 Edition Campus',
 'transmission': 'manual',
 'trim': 'Edition Campus',
 'year': 2007}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK03700%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.de] INFO: Saving data for MK03700: {'auction_closing_time': 1774713685.0, 'created_time': 1774607907.853747, 'last_price_update_time': 1774695947.121129}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK03700') HTTP/1.1" 204 0
2026-03-28 11:05:47 [auto1.de] INFO: Found listing with ID: FK77468
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK77468%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.de] INFO: Scrape type for FK77468: 2
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 063f4963-6797-5479-b1f6-bfbb42498df7 with identifier: FK77468
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 063f4963-6797-5479-b1f6-bfbb42498df7 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 063f4963-6797-5479-b1f6-bfbb42498df7 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 063f4963-6797-5479-b1f6-bfbb42498df7, identifier: FK77468
2026-03-28 11:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 063f4963-6797-5479-b1f6-bfbb42498df7 with identifier: FK77468
2026-03-28 11:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 063f4963-6797-5479-b1f6-bfbb42498df7 with identifier: FK77468
2026-03-28 11:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 063f4963-6797-5479-b1f6-bfbb42498df7 with identifier: FK77468 to the API
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:29:12Z',
 'fuel_type': 'petrol',
 'id': '063f4963-6797-5479-b1f6-bfbb42498df7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK77468',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 192653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-03',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK77468%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.de] INFO: Saving data for FK77468: {'auction_closing_time': 1774715352.0, 'created_time': 1774607852.128608, 'last_price_update_time': 1774695947.565512}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK77468') HTTP/1.1" 204 0
2026-03-28 11:05:47 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.de] INFO: Scrape type for LW18163: 2
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1497bf16-a845-59af-8797-a627a7d61672 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1497bf16-a845-59af-8797-a627a7d61672 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1497bf16-a845-59af-8797-a627a7d61672, identifier: LW18163
2026-03-28 11:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163
2026-03-28 11:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163
2026-03-28 11:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1497bf16-a845-59af-8797-a627a7d61672 with identifier: LW18163 to the API
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:59:55Z',
 'fuel_type': 'diesel',
 'id': '1497bf16-a845-59af-8797-a627a7d61672',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW18163',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 206605,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2013}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [auto1.de] INFO: Saving data for LW18163: {'auction_closing_time': 1774717195.0, 'created_time': 1774607870.080896, 'last_price_update_time': 1774695947.983436}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW18163') HTTP/1.1" 204 0
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: AG44420
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: LL66179
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: VP53971
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [auto1.de] INFO: Scrape type for BD50097: 2
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af297216-e1f5-5156-a455-3c8afaf1467b with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af297216-e1f5-5156-a455-3c8afaf1467b with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af297216-e1f5-5156-a455-3c8afaf1467b, identifier: BD50097
2026-03-28 11:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097
2026-03-28 11:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097
2026-03-28 11:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af297216-e1f5-5156-a455-3c8afaf1467b with identifier: BD50097 to the API
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:24:54Z',
 'fuel_type': 'petrol',
 'id': 'af297216-e1f5-5156-a455-3c8afaf1467b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD50097',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 57107,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-06',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [auto1.de] INFO: Saving data for BD50097: {'auction_closing_time': 1774715094.0, 'created_time': 1774607938.354709, 'last_price_update_time': 1774695948.441908}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD50097') HTTP/1.1" 204 0
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [auto1.de] INFO: Scrape type for HM57840: 2
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1840c47c-e51b-5fee-bfff-05055c749594 with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1840c47c-e51b-5fee-bfff-05055c749594 with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1840c47c-e51b-5fee-bfff-05055c749594, identifier: HM57840
2026-03-28 11:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840
2026-03-28 11:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840
2026-03-28 11:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1840c47c-e51b-5fee-bfff-05055c749594 with identifier: HM57840 to the API
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:52:18Z',
 'fuel_type': 'petrol',
 'id': '1840c47c-e51b-5fee-bfff-05055c749594',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM57840',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 103504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-11',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.1 ClearTec Inform',
 'transmission': 'manual',
 'trim': 'ClearTec Inform',
 'year': 2009}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [auto1.de] INFO: Saving data for HM57840: {'auction_closing_time': 1774716738.0, 'created_time': 1774608090.429291, 'last_price_update_time': 1774695948.963997}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM57840') HTTP/1.1" 204 0
2026-03-28 11:05:48 [auto1.de] INFO: Found listing with ID: FB90112
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB90112%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Scrape type for FB90112: 2
2026-03-28 11:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05b91194-de22-5a83-b2ca-b71431976efb with identifier: FB90112
2026-03-28 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b91194-de22-5a83-b2ca-b71431976efb with scrape type 2
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05b91194-de22-5a83-b2ca-b71431976efb with scrape type 2
2026-03-28 11:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05b91194-de22-5a83-b2ca-b71431976efb, identifier: FB90112
2026-03-28 11:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05b91194-de22-5a83-b2ca-b71431976efb with identifier: FB90112
2026-03-28 11:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05b91194-de22-5a83-b2ca-b71431976efb with identifier: FB90112
2026-03-28 11:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05b91194-de22-5a83-b2ca-b71431976efb with identifier: FB90112 to the API
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:46Z',
 'fuel_type': 'diesel',
 'id': '05b91194-de22-5a83-b2ca-b71431976efb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB90112',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 234839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-18',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2011}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB90112%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Saving data for FB90112: {'auction_closing_time': 1774715986.0, 'created_time': 1774608088.526271, 'last_price_update_time': 1774695949.413792}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB90112') HTTP/1.1" 204 0
2026-03-28 11:05:49 [auto1.de] INFO: Found listing with ID: JW30909
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW30909%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Scrape type for JW30909: 0
2026-03-28 11:05:49 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-28 11:05:49 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-28 11:05:49 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Scrape type for VV46432: 2
2026-03-28 11:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432
2026-03-28 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with scrape type 2
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with scrape type 2
2026-03-28 11:05:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a, identifier: VV46432
2026-03-28 11:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432
2026-03-28 11:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432
2026-03-28 11:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 125ad95c-e2f3-5f4a-9884-95b2a29e5c4a with identifier: VV46432 to the API
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-28T16:49:18Z',
 'fuel_type': 'petrol',
 'id': '125ad95c-e2f3-5f4a-9884-95b2a29e5c4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV46432',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5',
 'odometer': 4925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-13',
 'seller_name': None,
 'title': 'Audi S5 3.0 TFSI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2024}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Saving data for VV46432: {'auction_closing_time': 1774716558.0, 'created_time': 1774608076.490126, 'last_price_update_time': 1774695949.869964}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV46432') HTTP/1.1" 204 0
2026-03-28 11:05:49 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [auto1.de] INFO: Scrape type for KS78216: 2
2026-03-28 11:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216
2026-03-28 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4bf374e-3d58-5714-8290-da8e35fc7eab with scrape type 2
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4bf374e-3d58-5714-8290-da8e35fc7eab with scrape type 2
2026-03-28 11:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4bf374e-3d58-5714-8290-da8e35fc7eab, identifier: KS78216
2026-03-28 11:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216
2026-03-28 11:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216
2026-03-28 11:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4bf374e-3d58-5714-8290-da8e35fc7eab with identifier: KS78216 to the API
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:17:12Z',
 'fuel_type': 'petrol',
 'id': 'd4bf374e-3d58-5714-8290-da8e35fc7eab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS78216',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 87652,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-23',
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2006}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [auto1.de] INFO: Saving data for KS78216: {'auction_closing_time': 1774714632.0, 'created_time': 1774608087.854586, 'last_price_update_time': 1774695950.329697}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS78216') HTTP/1.1" 204 0
2026-03-28 11:05:50 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [auto1.de] INFO: Scrape type for RC79950: 2
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with scrape type 2
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with scrape type 2
2026-03-28 11:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d05fbefd-eebc-541e-8bfc-188e30d0f7a7, identifier: RC79950
2026-03-28 11:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950
2026-03-28 11:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950
2026-03-28 11:05:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d05fbefd-eebc-541e-8bfc-188e30d0f7a7 with identifier: RC79950 to the API
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:18:36Z',
 'fuel_type': 'petrol',
 'id': 'd05fbefd-eebc-541e-8bfc-188e30d0f7a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC79950',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 141717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2012}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [auto1.de] INFO: Saving data for RC79950: {'auction_closing_time': 1774714716.0, 'created_time': 1774608074.248467, 'last_price_update_time': 1774695950.786686}
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC79950') HTTP/1.1" 204 0
2026-03-28 11:05:50 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [auto1.de] INFO: Scrape type for UL59525: 2
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with scrape type 2
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with scrape type 2
2026-03-28 11:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862, identifier: UL59525
2026-03-28 11:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525
2026-03-28 11:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525
2026-03-28 11:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b0dc56a-d463-5dcc-9dc1-2355f79b7862 with identifier: UL59525 to the API
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:03:48Z',
 'fuel_type': 'diesel',
 'id': '4b0dc56a-d463-5dcc-9dc1-2355f79b7862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL59525',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 354078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2011}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [auto1.de] INFO: Saving data for UL59525: {'auction_closing_time': 1774713828.0, 'created_time': 1773946710.247724, 'last_price_update_time': 1774695951.635355}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL59525') HTTP/1.1" 204 0
2026-03-28 11:05:51 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-28 11:05:51 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-28 11:05:51 [auto1.de] INFO: Found listing with ID: UF20593
2026-03-28 11:05:51 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-28 11:05:51 [auto1.de] INFO: Found listing with ID: UN23019
2026-03-28 11:06:06 [scrapy.extensions.logstats] INFO: Crawled 419 pages (at 4 pages/min), scraped 383 items (at 82 items/min)
2026-03-28 11:06:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:07:06 [scrapy.extensions.logstats] INFO: Crawled 419 pages (at 0 pages/min), scraped 383 items (at 0 items/min)
2026-03-28 11:07:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:07:54 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 133.402(s), this was the 1st time calling it.
2026-03-28 11:07:54 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.208251071300731 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 11:07:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 11:08:06 [scrapy.extensions.logstats] INFO: Crawled 419 pages (at 0 pages/min), scraped 383 items (at 0 items/min)
2026-03-28 11:08:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:08:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:07 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 9705 | hits on page: 40
2026-03-28 11:08:07 [auto1.de] INFO: Found listing with ID: UF20593
2026-03-28 11:08:07 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-28 11:08:07 [auto1.de] INFO: Found listing with ID: UN23019
2026-03-28 11:08:07 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-28 11:08:07 [auto1.de] INFO: Found listing with ID: AC15853
2026-03-28 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC15853%27 HTTP/1.1" 200 None
2026-03-28 11:08:07 [auto1.de] INFO: Scrape type for AC15853: 2
2026-03-28 11:08:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dcf64c8-b58b-505c-b16b-6c757f623975 with identifier: AC15853
2026-03-28 11:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dcf64c8-b58b-505c-b16b-6c757f623975 with scrape type 2
2026-03-28 11:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dcf64c8-b58b-505c-b16b-6c757f623975 with scrape type 2
2026-03-28 11:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dcf64c8-b58b-505c-b16b-6c757f623975, identifier: AC15853
2026-03-28 11:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dcf64c8-b58b-505c-b16b-6c757f623975 with identifier: AC15853
2026-03-28 11:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dcf64c8-b58b-505c-b16b-6c757f623975 with identifier: AC15853
2026-03-28 11:08:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dcf64c8-b58b-505c-b16b-6c757f623975 with identifier: AC15853 to the API
2026-03-28 11:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:35Z',
 'fuel_type': 'diesel',
 'id': '2dcf64c8-b58b-505c-b16b-6c757f623975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC15853',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 183771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 d 4Matic Style',
 'transmission': 'automatic',
 'trim': '4Matic Style',
 'year': 2021}
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC15853%27 HTTP/1.1" 200 None
2026-03-28 11:08:08 [auto1.de] INFO: Saving data for AC15853: {'auction_closing_time': 1774716515.0, 'created_time': 1774608090.883994, 'last_price_update_time': 1774696088.040822}
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC15853') HTTP/1.1" 204 0
2026-03-28 11:08:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:08 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-28 11:08:08 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-28 11:08:08 [auto1.de] INFO: Scrape type for SP19687: 2
2026-03-28 11:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687
2026-03-28 11:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d96ab93a-d552-5c2c-9238-406f18cf2b9b with scrape type 2
2026-03-28 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d96ab93a-d552-5c2c-9238-406f18cf2b9b with scrape type 2
2026-03-28 11:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d96ab93a-d552-5c2c-9238-406f18cf2b9b, identifier: SP19687
2026-03-28 11:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687
2026-03-28 11:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687
2026-03-28 11:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d96ab93a-d552-5c2c-9238-406f18cf2b9b with identifier: SP19687 to the API
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-28T16:56:37Z',
 'fuel_type': 'petrol',
 'id': 'd96ab93a-d552-5c2c-9238-406f18cf2b9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP19687',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 93614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-17',
 'seller_name': None,
 'title': 'MINI Clubman Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-28 11:08:08 [auto1.de] INFO: Saving data for SP19687: {'auction_closing_time': 1774716997.0, 'created_time': 1774608196.173304, 'last_price_update_time': 1774696088.526772}
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP19687') HTTP/1.1" 204 0
2026-03-28 11:08:08 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-28 11:08:08 [auto1.de] INFO: Found listing with ID: LU27790
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU27790%27 HTTP/1.1" 200 None
2026-03-28 11:08:08 [auto1.de] INFO: Scrape type for LU27790: 2
2026-03-28 11:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb07bd82-b0bd-5075-8364-624ab9506f2f with identifier: LU27790
2026-03-28 11:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb07bd82-b0bd-5075-8364-624ab9506f2f with scrape type 2
2026-03-28 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb07bd82-b0bd-5075-8364-624ab9506f2f with scrape type 2
2026-03-28 11:08:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb07bd82-b0bd-5075-8364-624ab9506f2f, identifier: LU27790
2026-03-28 11:08:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb07bd82-b0bd-5075-8364-624ab9506f2f with identifier: LU27790
2026-03-28 11:08:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb07bd82-b0bd-5075-8364-624ab9506f2f with identifier: LU27790
2026-03-28 11:08:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb07bd82-b0bd-5075-8364-624ab9506f2f with identifier: LU27790 to the API
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:12:55Z',
 'fuel_type': 'diesel',
 'id': 'fb07bd82-b0bd-5075-8364-624ab9506f2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU27790',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 56213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-17',
 'seller_name': None,
 'title': 'MINI One D BAKER STREET',
 'transmission': 'manual',
 'trim': 'BAKER STREET',
 'year': 2013}
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU27790%27 HTTP/1.1" 200 None
2026-03-28 11:08:08 [auto1.de] INFO: Saving data for LU27790: {'auction_closing_time': 1774714375.0, 'created_time': 1774608093.989997, 'last_price_update_time': 1774696088.911686}
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU27790') HTTP/1.1" 204 0
2026-03-28 11:08:08 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-28 11:08:08 [auto1.de] INFO: Scrape type for RG76834: 2
2026-03-28 11:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834
2026-03-28 11:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba9fe0ef-8338-5fda-b3fd-dac274aa566a with scrape type 2
2026-03-28 11:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba9fe0ef-8338-5fda-b3fd-dac274aa566a with scrape type 2
2026-03-28 11:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba9fe0ef-8338-5fda-b3fd-dac274aa566a, identifier: RG76834
2026-03-28 11:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834
2026-03-28 11:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834
2026-03-28 11:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba9fe0ef-8338-5fda-b3fd-dac274aa566a with identifier: RG76834 to the API
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:32:04Z',
 'fuel_type': 'petrol',
 'id': 'ba9fe0ef-8338-5fda-b3fd-dac274aa566a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG76834',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 133356,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-14',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-28 11:08:09 [auto1.de] INFO: Saving data for RG76834: {'auction_closing_time': 1774715524.0, 'created_time': 1774608053.998473, 'last_price_update_time': 1774696089.30201}
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG76834') HTTP/1.1" 204 0
2026-03-28 11:08:09 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-28 11:08:09 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-28 11:08:09 [auto1.de] INFO: Scrape type for UC42370: 2
2026-03-28 11:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370
2026-03-28 11:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a with scrape type 2
2026-03-28 11:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02e33a2d-6e43-5099-902d-7c9ab13bc33a with scrape type 2
2026-03-28 11:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e33a2d-6e43-5099-902d-7c9ab13bc33a, identifier: UC42370
2026-03-28 11:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370
2026-03-28 11:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370
2026-03-28 11:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e33a2d-6e43-5099-902d-7c9ab13bc33a with identifier: UC42370 to the API
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:24:36Z',
 'fuel_type': 'petrol',
 'id': '02e33a2d-6e43-5099-902d-7c9ab13bc33a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC42370',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 66257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-10',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-28 11:08:09 [auto1.de] INFO: Saving data for UC42370: {'auction_closing_time': 1774715076.0, 'created_time': 1774608066.222625, 'last_price_update_time': 1774696089.699138}
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC42370') HTTP/1.1" 204 0
2026-03-28 11:08:09 [auto1.de] INFO: Found listing with ID: VC15219
2026-03-28 11:08:09 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-28 11:08:09 [auto1.de] INFO: Scrape type for BN55276: 2
2026-03-28 11:08:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276
2026-03-28 11:08:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c93bf116-19cf-5fff-abcc-d3c64aece2a6 with scrape type 2
2026-03-28 11:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c93bf116-19cf-5fff-abcc-d3c64aece2a6 with scrape type 2
2026-03-28 11:08:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c93bf116-19cf-5fff-abcc-d3c64aece2a6, identifier: BN55276
2026-03-28 11:08:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276
2026-03-28 11:08:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276
2026-03-28 11:08:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c93bf116-19cf-5fff-abcc-d3c64aece2a6 with identifier: BN55276 to the API
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 151,
 'expiration_date': '2026-03-28T16:45:31Z',
 'fuel_type': 'petrol',
 'id': 'c93bf116-19cf-5fff-abcc-d3c64aece2a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN55276',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 46113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-23',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 Turbo Cross',
 'transmission': 'automatic',
 'trim': 'Cross',
 'year': 2021}
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.de] INFO: Saving data for BN55276: {'auction_closing_time': 1774716331.0, 'created_time': 1773400902.368161, 'last_price_update_time': 1774696090.11767}
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN55276') HTTP/1.1" 204 0
2026-03-28 11:08:10 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-28 11:08:10 [auto1.de] INFO: Found listing with ID: SJ87943
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ87943%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.de] INFO: Scrape type for SJ87943: 2
2026-03-28 11:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1225177-117f-5078-8146-1d685e4c4fa4 with identifier: SJ87943
2026-03-28 11:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1225177-117f-5078-8146-1d685e4c4fa4 with scrape type 2
2026-03-28 11:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1225177-117f-5078-8146-1d685e4c4fa4 with scrape type 2
2026-03-28 11:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1225177-117f-5078-8146-1d685e4c4fa4, identifier: SJ87943
2026-03-28 11:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1225177-117f-5078-8146-1d685e4c4fa4 with identifier: SJ87943
2026-03-28 11:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1225177-117f-5078-8146-1d685e4c4fa4 with identifier: SJ87943
2026-03-28 11:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1225177-117f-5078-8146-1d685e4c4fa4 with identifier: SJ87943 to the API
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:05:59Z',
 'fuel_type': 'petrol',
 'id': 'd1225177-117f-5078-8146-1d685e4c4fa4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ87943',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 63681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2016}
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ87943%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.de] INFO: Saving data for SJ87943: {'auction_closing_time': 1774713959.0, 'created_time': 1774608097.64536, 'last_price_update_time': 1774696090.534605}
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ87943') HTTP/1.1" 204 0
2026-03-28 11:08:10 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-28 11:08:10 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-28 11:08:10 [auto1.de] INFO: Scrape type for EA40469: 2
2026-03-28 11:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469
2026-03-28 11:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bea29f7e-cce3-5300-b779-898fd8dd79f3 with scrape type 2
2026-03-28 11:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bea29f7e-cce3-5300-b779-898fd8dd79f3 with scrape type 2
2026-03-28 11:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bea29f7e-cce3-5300-b779-898fd8dd79f3, identifier: EA40469
2026-03-28 11:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469
2026-03-28 11:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469
2026-03-28 11:08:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bea29f7e-cce3-5300-b779-898fd8dd79f3 with identifier: EA40469 to the API
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:00:42Z',
 'fuel_type': 'petrol',
 'id': 'bea29f7e-cce3-5300-b779-898fd8dd79f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA40469',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 142888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-08',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.de] INFO: Saving data for EA40469: {'auction_closing_time': 1774713642.0, 'created_time': 1774608045.731351, 'last_price_update_time': 1774696091.021118}
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA40469') HTTP/1.1" 204 0
2026-03-28 11:08:11 [auto1.de] INFO: Found listing with ID: MA93398
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA93398%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.de] INFO: Scrape type for MA93398: 2
2026-03-28 11:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80b3e699-b153-5c86-9d0f-190ccd31e032 with identifier: MA93398
2026-03-28 11:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80b3e699-b153-5c86-9d0f-190ccd31e032 with scrape type 2
2026-03-28 11:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80b3e699-b153-5c86-9d0f-190ccd31e032 with scrape type 2
2026-03-28 11:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80b3e699-b153-5c86-9d0f-190ccd31e032, identifier: MA93398
2026-03-28 11:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80b3e699-b153-5c86-9d0f-190ccd31e032 with identifier: MA93398
2026-03-28 11:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80b3e699-b153-5c86-9d0f-190ccd31e032 with identifier: MA93398
2026-03-28 11:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80b3e699-b153-5c86-9d0f-190ccd31e032 with identifier: MA93398 to the API
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:29:46Z',
 'fuel_type': 'petrol',
 'id': '80b3e699-b153-5c86-9d0f-190ccd31e032',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA93398',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 61441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-02',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA93398%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.de] INFO: Saving data for MA93398: {'auction_closing_time': 1774715386.0, 'created_time': 1774608009.184302, 'last_price_update_time': 1774696091.434289}
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA93398') HTTP/1.1" 204 0
2026-03-28 11:08:11 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-28 11:08:11 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-28 11:08:11 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-28 11:08:11 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-28 11:08:11 [auto1.de] INFO: Found listing with ID: TX89120
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX89120%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.de] INFO: Scrape type for TX89120: 2
2026-03-28 11:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23414e8d-2f88-5a50-a9a3-5035574efa54 with identifier: TX89120
2026-03-28 11:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23414e8d-2f88-5a50-a9a3-5035574efa54 with scrape type 2
2026-03-28 11:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23414e8d-2f88-5a50-a9a3-5035574efa54 with scrape type 2
2026-03-28 11:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23414e8d-2f88-5a50-a9a3-5035574efa54, identifier: TX89120
2026-03-28 11:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23414e8d-2f88-5a50-a9a3-5035574efa54 with identifier: TX89120
2026-03-28 11:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23414e8d-2f88-5a50-a9a3-5035574efa54 with identifier: TX89120
2026-03-28 11:08:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23414e8d-2f88-5a50-a9a3-5035574efa54 with identifier: TX89120 to the API
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:19:18Z',
 'fuel_type': 'diesel',
 'id': '23414e8d-2f88-5a50-a9a3-5035574efa54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX89120',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 303555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-17',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2012}
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX89120%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.de] INFO: Saving data for TX89120: {'auction_closing_time': 1774714758.0, 'created_time': 1774608013.189323, 'last_price_update_time': 1774696091.84337}
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX89120') HTTP/1.1" 204 0
2026-03-28 11:08:11 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-28 11:08:11 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-28 11:08:11 [auto1.de] INFO: Scrape type for YS81106: 2
2026-03-28 11:08:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106
2026-03-28 11:08:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with scrape type 2
2026-03-28 11:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with scrape type 2
2026-03-28 11:08:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0684b6c-6f56-5f95-8f3d-5dd375dd0713, identifier: YS81106
2026-03-28 11:08:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106
2026-03-28 11:08:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106
2026-03-28 11:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0684b6c-6f56-5f95-8f3d-5dd375dd0713 with identifier: YS81106 to the API
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:58:45Z',
 'fuel_type': 'petrol',
 'id': 'b0684b6c-6f56-5f95-8f3d-5dd375dd0713',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS81106',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 35739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-05',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2022}
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.de] INFO: Saving data for YS81106: {'auction_closing_time': 1774717125.0, 'created_time': 1774607934.480418, 'last_price_update_time': 1774696092.254633}
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS81106') HTTP/1.1" 204 0
2026-03-28 11:08:12 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.de] INFO: Scrape type for AK08323: 2
2026-03-28 11:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323
2026-03-28 11:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c276a8-99d1-5247-aa38-db4ac122d928 with scrape type 2
2026-03-28 11:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45c276a8-99d1-5247-aa38-db4ac122d928 with scrape type 2
2026-03-28 11:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45c276a8-99d1-5247-aa38-db4ac122d928, identifier: AK08323
2026-03-28 11:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323
2026-03-28 11:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323
2026-03-28 11:08:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45c276a8-99d1-5247-aa38-db4ac122d928 with identifier: AK08323 to the API
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:26:34Z',
 'fuel_type': 'petrol',
 'id': '45c276a8-99d1-5247-aa38-db4ac122d928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK08323',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 76182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-12',
 'seller_name': None,
 'title': 'Jaguar E-Pace P250 R-Dynamic HSE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic HSE AWD',
 'year': 2018}
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.de] INFO: Saving data for AK08323: {'auction_closing_time': 1774715194.0, 'created_time': 1773984975.644639, 'last_price_update_time': 1774696092.677806}
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK08323') HTTP/1.1" 204 0
2026-03-28 11:08:12 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-28 11:08:12 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-28 11:08:12 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-28 11:08:12 [auto1.de] INFO: Scrape type for XY47977: 2
2026-03-28 11:08:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977
2026-03-28 11:08:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with scrape type 2
2026-03-28 11:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with scrape type 2
2026-03-28 11:08:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366, identifier: XY47977
2026-03-28 11:08:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977
2026-03-28 11:08:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977
2026-03-28 11:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ada0154-2dce-5ea5-ac7f-71d4a6dcc366 with identifier: XY47977 to the API
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:29:09Z',
 'fuel_type': 'petrol',
 'id': '3ada0154-2dce-5ea5-ac7f-71d4a6dcc366',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY47977',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 157399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-12',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.de] INFO: Saving data for XY47977: {'auction_closing_time': 1774715349.0, 'created_time': 1774607933.858252, 'last_price_update_time': 1774696093.190331}
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY47977') HTTP/1.1" 204 0
2026-03-28 11:08:13 [auto1.de] INFO: Found listing with ID: HL08327
2026-03-28 11:08:13 [auto1.de] INFO: Found listing with ID: PS35101
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS35101%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.de] INFO: Scrape type for PS35101: 2
2026-03-28 11:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e235fbb-29c6-5be6-8d72-1511d219f418 with identifier: PS35101
2026-03-28 11:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e235fbb-29c6-5be6-8d72-1511d219f418 with scrape type 2
2026-03-28 11:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e235fbb-29c6-5be6-8d72-1511d219f418 with scrape type 2
2026-03-28 11:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e235fbb-29c6-5be6-8d72-1511d219f418, identifier: PS35101
2026-03-28 11:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e235fbb-29c6-5be6-8d72-1511d219f418 with identifier: PS35101
2026-03-28 11:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e235fbb-29c6-5be6-8d72-1511d219f418 with identifier: PS35101
2026-03-28 11:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e235fbb-29c6-5be6-8d72-1511d219f418 with identifier: PS35101 to the API
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:28:38Z',
 'fuel_type': 'petrol',
 'id': '2e235fbb-29c6-5be6-8d72-1511d219f418',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS35101',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 51116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Cup',
 'transmission': 'automatic',
 'trim': 'Cup',
 'year': 2015}
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS35101%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.de] INFO: Saving data for PS35101: {'auction_closing_time': 1774715318.0, 'created_time': 1773341586.502563, 'last_price_update_time': 1774696093.610979}
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS35101') HTTP/1.1" 204 0
2026-03-28 11:08:13 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-28 11:08:13 [auto1.de] INFO: Scrape type for NC46979: 2
2026-03-28 11:08:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979
2026-03-28 11:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bdd9516-2c72-501c-91fb-f10500fbcd1e with scrape type 2
2026-03-28 11:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bdd9516-2c72-501c-91fb-f10500fbcd1e with scrape type 2
2026-03-28 11:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bdd9516-2c72-501c-91fb-f10500fbcd1e, identifier: NC46979
2026-03-28 11:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979
2026-03-28 11:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979
2026-03-28 11:08:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bdd9516-2c72-501c-91fb-f10500fbcd1e with identifier: NC46979 to the API
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:24:46Z',
 'fuel_type': 'diesel',
 'id': '4bdd9516-2c72-501c-91fb-f10500fbcd1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC46979',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 125285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-13',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.de] INFO: Saving data for NC46979: {'auction_closing_time': 1774715086.0, 'created_time': 1773383627.538955, 'last_price_update_time': 1774696094.026667}
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC46979') HTTP/1.1" 204 0
2026-03-28 11:08:14 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.de] INFO: Scrape type for SB81454: 2
2026-03-28 11:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454
2026-03-28 11:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa22120-cf3a-51f8-b850-1de84f4d2282 with scrape type 2
2026-03-28 11:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faa22120-cf3a-51f8-b850-1de84f4d2282 with scrape type 2
2026-03-28 11:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faa22120-cf3a-51f8-b850-1de84f4d2282, identifier: SB81454
2026-03-28 11:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454
2026-03-28 11:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454
2026-03-28 11:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faa22120-cf3a-51f8-b850-1de84f4d2282 with identifier: SB81454 to the API
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:03:20Z',
 'fuel_type': 'diesel',
 'id': 'faa22120-cf3a-51f8-b850-1de84f4d2282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB81454',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 99844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-13',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2010}
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.de] INFO: Saving data for SB81454: {'auction_closing_time': 1774713800.0, 'created_time': 1773946316.304271, 'last_price_update_time': 1774696094.445328}
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB81454') HTTP/1.1" 204 0
2026-03-28 11:08:14 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.de] INFO: Scrape type for GE16553: 2
2026-03-28 11:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553
2026-03-28 11:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with scrape type 2
2026-03-28 11:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with scrape type 2
2026-03-28 11:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d, identifier: GE16553
2026-03-28 11:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553
2026-03-28 11:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553
2026-03-28 11:08:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d with identifier: GE16553 to the API
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:47:28Z',
 'fuel_type': 'diesel',
 'id': 'dedc6f6c-f843-5bb1-b3d1-b2c79a667d2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE16553',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 103087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-17',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'automatic',
 'trim': '310 L1 Sport',
 'year': 2019}
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.de] INFO: Saving data for GE16553: {'auction_closing_time': 1774716448.0, 'created_time': 1774608022.077746, 'last_price_update_time': 1774696094.831122}
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE16553') HTTP/1.1" 204 0
2026-03-28 11:08:14 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-28 11:08:14 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-28 11:08:14 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-28 11:08:14 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-28 11:08:14 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-28 11:08:14 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 9705 | hits on page: 40
2026-03-28 11:08:14 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-28 11:08:14 [auto1.de] INFO: Scrape type for ZR01639: 2
2026-03-28 11:08:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639
2026-03-28 11:08:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with scrape type 2
2026-03-28 11:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with scrape type 2
2026-03-28 11:08:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ca74376-76c1-5ed1-94ff-614a861ec9b5, identifier: ZR01639
2026-03-28 11:08:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639
2026-03-28 11:08:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639
2026-03-28 11:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ca74376-76c1-5ed1-94ff-614a861ec9b5 with identifier: ZR01639 to the API
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:26:53Z',
 'fuel_type': 'petrol',
 'id': '8ca74376-76c1-5ed1-94ff-614a861ec9b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR01639',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 56795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-12',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2021}
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-28 11:08:15 [auto1.de] INFO: Saving data for ZR01639: {'auction_closing_time': 1774715213.0, 'created_time': 1773428974.29145, 'last_price_update_time': 1774696095.246333}
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR01639') HTTP/1.1" 204 0
2026-03-28 11:08:15 [auto1.de] INFO: Found listing with ID: LA14502
2026-03-28 11:08:15 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-28 11:08:15 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-28 11:08:15 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-28 11:08:15 [auto1.de] INFO: Scrape type for ZP29614: 2
2026-03-28 11:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614
2026-03-28 11:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ff3db46-c194-5187-9ec7-67543c85209e with scrape type 2
2026-03-28 11:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ff3db46-c194-5187-9ec7-67543c85209e with scrape type 2
2026-03-28 11:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ff3db46-c194-5187-9ec7-67543c85209e, identifier: ZP29614
2026-03-28 11:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614
2026-03-28 11:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614
2026-03-28 11:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ff3db46-c194-5187-9ec7-67543c85209e with identifier: ZP29614 to the API
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:14:54Z',
 'fuel_type': 'diesel',
 'id': '6ff3db46-c194-5187-9ec7-67543c85209e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP29614',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 166750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-11',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2023}
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-28 11:08:15 [auto1.de] INFO: Saving data for ZP29614: {'auction_closing_time': 1774714494.0, 'created_time': 1774607963.910998, 'last_price_update_time': 1774696095.725317}
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP29614') HTTP/1.1" 204 0
2026-03-28 11:08:15 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-28 11:08:15 [auto1.de] INFO: Scrape type for XU86679: 2
2026-03-28 11:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679
2026-03-28 11:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc48c99e-4337-579d-8523-cf9e36237100 with scrape type 2
2026-03-28 11:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc48c99e-4337-579d-8523-cf9e36237100 with scrape type 2
2026-03-28 11:08:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc48c99e-4337-579d-8523-cf9e36237100, identifier: XU86679
2026-03-28 11:08:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679
2026-03-28 11:08:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679
2026-03-28 11:08:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc48c99e-4337-579d-8523-cf9e36237100 with identifier: XU86679 to the API
2026-03-28 11:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:03Z',
 'fuel_type': 'petrol',
 'id': 'cc48c99e-4337-579d-8523-cf9e36237100',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU86679',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 52202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-26',
 'seller_name': None,
 'title': 'Seat Arona 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2022}
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.de] INFO: Saving data for XU86679: {'auction_closing_time': 1774715163.0, 'created_time': 1773344426.681026, 'last_price_update_time': 1774696096.170443}
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU86679') HTTP/1.1" 204 0
2026-03-28 11:08:16 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.de] INFO: Scrape type for EX22671: 2
2026-03-28 11:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671
2026-03-28 11:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4cdf85-78e5-5e8b-acc4-acb367780537 with scrape type 2
2026-03-28 11:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b4cdf85-78e5-5e8b-acc4-acb367780537 with scrape type 2
2026-03-28 11:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b4cdf85-78e5-5e8b-acc4-acb367780537, identifier: EX22671
2026-03-28 11:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671
2026-03-28 11:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671
2026-03-28 11:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b4cdf85-78e5-5e8b-acc4-acb367780537 with identifier: EX22671 to the API
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:43Z',
 'fuel_type': 'petrol',
 'id': '3b4cdf85-78e5-5e8b-acc4-acb367780537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX22671',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 135909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.de] INFO: Saving data for EX22671: {'auction_closing_time': 1774715203.0, 'created_time': 1774608028.557649, 'last_price_update_time': 1774696096.573838}
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX22671') HTTP/1.1" 204 0
2026-03-28 11:08:16 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-28 11:08:16 [auto1.de] INFO: Scrape type for UH40808: 2
2026-03-28 11:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808
2026-03-28 11:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with scrape type 2
2026-03-28 11:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with scrape type 2
2026-03-28 11:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c, identifier: UH40808
2026-03-28 11:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808
2026-03-28 11:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808
2026-03-28 11:08:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bc8adaf-a9e8-510e-a96f-641f78a0a15c with identifier: UH40808 to the API
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:47:02Z',
 'fuel_type': 'hybrid',
 'id': '9bc8adaf-a9e8-510e-a96f-641f78a0a15c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH40808',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 27201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.de] INFO: Saving data for UH40808: {'auction_closing_time': 1774716422.0, 'created_time': 1774607967.863991, 'last_price_update_time': 1774696097.00008}
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH40808') HTTP/1.1" 204 0
2026-03-28 11:08:17 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.de] INFO: Scrape type for ZE17013: 2
2026-03-28 11:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013
2026-03-28 11:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with scrape type 2
2026-03-28 11:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with scrape type 2
2026-03-28 11:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8f96efe-8ba1-5dc9-8cec-76fac3d74696, identifier: ZE17013
2026-03-28 11:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013
2026-03-28 11:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013
2026-03-28 11:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8f96efe-8ba1-5dc9-8cec-76fac3d74696 with identifier: ZE17013 to the API
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:06:16Z',
 'fuel_type': 'petrol',
 'id': 'e8f96efe-8ba1-5dc9-8cec-76fac3d74696',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE17013',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 92020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-26',
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo S-Design City Look',
 'transmission': 'automatic',
 'trim': 'S-Design City Look',
 'year': 2017}
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.de] INFO: Saving data for ZE17013: {'auction_closing_time': 1774713976.0, 'created_time': 1774607951.946302, 'last_price_update_time': 1774696097.390435}
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE17013') HTTP/1.1" 204 0
2026-03-28 11:08:17 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.de] INFO: Scrape type for EJ47676: 2
2026-03-28 11:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676
2026-03-28 11:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with scrape type 2
2026-03-28 11:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with scrape type 2
2026-03-28 11:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc, identifier: EJ47676
2026-03-28 11:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676
2026-03-28 11:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676
2026-03-28 11:08:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19d2bdcf-827a-5a9d-82e6-277e49db4bcc with identifier: EJ47676 to the API
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:05Z',
 'fuel_type': 'diesel',
 'id': '19d2bdcf-827a-5a9d-82e6-277e49db4bcc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ47676',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 159800,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.de] INFO: Saving data for EJ47676: {'auction_closing_time': 1774716725.0, 'created_time': 1773227164.060533, 'last_price_update_time': 1774696097.786015}
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ47676') HTTP/1.1" 204 0
2026-03-28 11:08:17 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-28 11:08:17 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-28 11:08:17 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-28 11:08:17 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-28 11:08:17 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-28 11:08:17 [auto1.de] INFO: Scrape type for KE92828: 2
2026-03-28 11:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828
2026-03-28 11:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bdb6f17-9819-5f37-b37a-257715535bca with scrape type 2
2026-03-28 11:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bdb6f17-9819-5f37-b37a-257715535bca with scrape type 2
2026-03-28 11:08:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bdb6f17-9819-5f37-b37a-257715535bca, identifier: KE92828
2026-03-28 11:08:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828
2026-03-28 11:08:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828
2026-03-28 11:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bdb6f17-9819-5f37-b37a-257715535bca with identifier: KE92828 to the API
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:44:53Z',
 'fuel_type': 'petrol',
 'id': '3bdb6f17-9819-5f37-b37a-257715535bca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE92828',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 81290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-28',
 'seller_name': None,
 'title': 'Dacia Duster 1.2 TCe Celebration 4x2',
 'transmission': 'manual',
 'trim': 'Celebration 4x2',
 'year': 2015}
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.de] INFO: Saving data for KE92828: {'auction_closing_time': 1774716293.0, 'created_time': 1773946615.33707, 'last_price_update_time': 1774696098.19983}
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE92828') HTTP/1.1" 204 0
2026-03-28 11:08:18 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-28 11:08:18 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-28 11:08:18 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-28 11:08:18 [auto1.de] INFO: Found listing with ID: BR67018
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR67018%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.de] INFO: Scrape type for BR67018: 2
2026-03-28 11:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with identifier: BR67018
2026-03-28 11:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with scrape type 2
2026-03-28 11:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with scrape type 2
2026-03-28 11:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95, identifier: BR67018
2026-03-28 11:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with identifier: BR67018
2026-03-28 11:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with identifier: BR67018
2026-03-28 11:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f6086c3-075b-5f4a-9712-6bf7b7ad5a95 with identifier: BR67018 to the API
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:21:24Z',
 'fuel_type': 'petrol',
 'id': '5f6086c3-075b-5f4a-9712-6bf7b7ad5a95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR67018',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 52601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-13',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR67018%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.de] INFO: Saving data for BR67018: {'auction_closing_time': 1774714884.0, 'created_time': 1774607955.679332, 'last_price_update_time': 1774696098.70575}
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR67018') HTTP/1.1" 204 0
2026-03-28 11:08:18 [auto1.de] INFO: Found listing with ID: EA75512
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA75512%27 HTTP/1.1" 200 None
2026-03-28 11:08:18 [auto1.de] INFO: Scrape type for EA75512: 2
2026-03-28 11:08:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: EA75512
2026-03-28 11:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with scrape type 2
2026-03-28 11:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with scrape type 2
2026-03-28 11:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf, identifier: EA75512
2026-03-28 11:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: EA75512
2026-03-28 11:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: EA75512
2026-03-28 11:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39a73000-d2ce-5a52-b8f5-a36cdb240ebf with identifier: EA75512 to the API
2026-03-28 11:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:15:38Z',
 'fuel_type': 'electro',
 'id': '39a73000-d2ce-5a52-b8f5-a36cdb240ebf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA75512',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 10,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-18',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA75512%27 HTTP/1.1" 200 None
2026-03-28 11:08:19 [auto1.de] INFO: Saving data for EA75512: {'auction_closing_time': 1774714538.0, 'created_time': 1774607937.308526, 'last_price_update_time': 1774696099.136751}
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA75512') HTTP/1.1" 204 0
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-28 11:08:19 [auto1.de] INFO: Scrape type for SU14525: 2
2026-03-28 11:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525
2026-03-28 11:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe with scrape type 2
2026-03-28 11:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96cac54-aefd-5e54-a0a7-2b702bfc4abe with scrape type 2
2026-03-28 11:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96cac54-aefd-5e54-a0a7-2b702bfc4abe, identifier: SU14525
2026-03-28 11:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525
2026-03-28 11:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525
2026-03-28 11:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96cac54-aefd-5e54-a0a7-2b702bfc4abe with identifier: SU14525 to the API
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:50:41Z',
 'fuel_type': 'diesel',
 'id': 'c96cac54-aefd-5e54-a0a7-2b702bfc4abe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU14525',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 71243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L2H1 3,5t',
 'transmission': 'manual',
 'trim': 'L2H1 3,5t',
 'year': 2018}
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-28 11:08:19 [auto1.de] INFO: Saving data for SU14525: {'auction_closing_time': 1774716641.0, 'created_time': 1774607965.374403, 'last_price_update_time': 1774696099.534819}
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU14525') HTTP/1.1" 204 0
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-28 11:08:19 [auto1.de] INFO: Scrape type for XH92207: 2
2026-03-28 11:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207
2026-03-28 11:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e46331e9-982e-5737-98ed-b7250cfd202d with scrape type 2
2026-03-28 11:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e46331e9-982e-5737-98ed-b7250cfd202d with scrape type 2
2026-03-28 11:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e46331e9-982e-5737-98ed-b7250cfd202d, identifier: XH92207
2026-03-28 11:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207
2026-03-28 11:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207
2026-03-28 11:08:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e46331e9-982e-5737-98ed-b7250cfd202d with identifier: XH92207 to the API
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:07:17Z',
 'fuel_type': 'petrol',
 'id': 'e46331e9-982e-5737-98ed-b7250cfd202d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH92207',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 169795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-25',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 150',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-28 11:08:19 [auto1.de] INFO: Saving data for XH92207: {'auction_closing_time': 1774714037.0, 'created_time': 1774608014.371783, 'last_price_update_time': 1774696099.934941}
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH92207') HTTP/1.1" 204 0
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: FL90187
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: EX64550
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: FZ93202
2026-03-28 11:08:19 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-28 11:08:19 [auto1.de] INFO: Scrape type for BD51611: 2
2026-03-28 11:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611
2026-03-28 11:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6394e207-b268-51c9-b24f-7418e5b80f7c with scrape type 2
2026-03-28 11:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6394e207-b268-51c9-b24f-7418e5b80f7c with scrape type 2
2026-03-28 11:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6394e207-b268-51c9-b24f-7418e5b80f7c, identifier: BD51611
2026-03-28 11:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611
2026-03-28 11:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611
2026-03-28 11:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6394e207-b268-51c9-b24f-7418e5b80f7c with identifier: BD51611 to the API
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:51:24Z',
 'fuel_type': 'petrol',
 'id': '6394e207-b268-51c9-b24f-7418e5b80f7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD51611',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fusion',
 'odometer': 147851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-30',
 'seller_name': None,
 'title': 'Ford Fusion 1.25 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2005}
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-28 11:08:20 [auto1.de] INFO: Saving data for BD51611: {'auction_closing_time': 1774716684.0, 'created_time': 1774608015.602678, 'last_price_update_time': 1774696100.367675}
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD51611') HTTP/1.1" 204 0
2026-03-28 11:08:20 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-28 11:08:20 [auto1.de] INFO: Scrape type for TT34897: 2
2026-03-28 11:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897
2026-03-28 11:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f983f4c-065d-5952-8729-e67adaf03168 with scrape type 2
2026-03-28 11:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f983f4c-065d-5952-8729-e67adaf03168 with scrape type 2
2026-03-28 11:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f983f4c-065d-5952-8729-e67adaf03168, identifier: TT34897
2026-03-28 11:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897
2026-03-28 11:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897
2026-03-28 11:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f983f4c-065d-5952-8729-e67adaf03168 with identifier: TT34897 to the API
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:01:03Z',
 'fuel_type': 'petrol',
 'id': '2f983f4c-065d-5952-8729-e67adaf03168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT34897',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 134826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-28 11:08:20 [auto1.de] INFO: Saving data for TT34897: {'auction_closing_time': 1774713663.0, 'created_time': 1774608015.045552, 'last_price_update_time': 1774696100.86064}
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT34897') HTTP/1.1" 204 0
2026-03-28 11:08:20 [auto1.de] INFO: Found listing with ID: ML20845
2026-03-28 11:08:20 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-28 11:08:20 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-28 11:08:20 [auto1.de] INFO: Found listing with ID: VG97349
2026-03-28 11:08:20 [auto1.de] INFO: Found listing with ID: BK65604
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK65604%27 HTTP/1.1" 200 None
2026-03-28 11:08:20 [auto1.de] INFO: Scrape type for BK65604: 2
2026-03-28 11:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with identifier: BK65604
2026-03-28 11:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with scrape type 2
2026-03-28 11:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with scrape type 2
2026-03-28 11:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb, identifier: BK65604
2026-03-28 11:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with identifier: BK65604
2026-03-28 11:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with identifier: BK65604
2026-03-28 11:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb with identifier: BK65604 to the API
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:05:05Z',
 'fuel_type': 'diesel',
 'id': '8955b9db-fbf4-53f0-bc11-fcdd1f79e2bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK65604',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 166320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Family Plus',
 'transmission': 'manual',
 'trim': 'Family Plus',
 'year': 2012}
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK65604%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.de] INFO: Saving data for BK65604: {'auction_closing_time': 1774713905.0, 'created_time': 1774608017.737482, 'last_price_update_time': 1774696101.280753}
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK65604') HTTP/1.1" 204 0
2026-03-28 11:08:21 [auto1.de] INFO: Found listing with ID: EP70088
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP70088%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.de] INFO: Scrape type for EP70088: 2
2026-03-28 11:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1aa1988-2205-589a-8056-74499d1d99da with identifier: EP70088
2026-03-28 11:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1aa1988-2205-589a-8056-74499d1d99da with scrape type 2
2026-03-28 11:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1aa1988-2205-589a-8056-74499d1d99da with scrape type 2
2026-03-28 11:08:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1aa1988-2205-589a-8056-74499d1d99da, identifier: EP70088
2026-03-28 11:08:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1aa1988-2205-589a-8056-74499d1d99da with identifier: EP70088
2026-03-28 11:08:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1aa1988-2205-589a-8056-74499d1d99da with identifier: EP70088
2026-03-28 11:08:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1aa1988-2205-589a-8056-74499d1d99da with identifier: EP70088 to the API
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:48Z',
 'fuel_type': 'diesel',
 'id': 'a1aa1988-2205-589a-8056-74499d1d99da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP70088',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 258296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Joy 4x4',
 'transmission': 'manual',
 'trim': 'Joy 4x4',
 'year': 2016}
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP70088%27 HTTP/1.1" 200 None
2026-03-28 11:08:21 [auto1.de] INFO: Saving data for EP70088: {'auction_closing_time': 1774716648.0, 'created_time': 1774607963.336038, 'last_price_update_time': 1774696101.687878}
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP70088') HTTP/1.1" 204 0
2026-03-28 11:08:21 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-28 11:08:21 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-28 11:08:21 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-28 11:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:26 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 9705 | hits on page: 40
2026-03-28 11:08:26 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-28 11:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-28 11:08:26 [auto1.de] INFO: Scrape type for XH60803: 2
2026-03-28 11:08:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803
2026-03-28 11:08:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f10d7e07-2d9b-5fc3-af76-43281d86d1cc with scrape type 2
2026-03-28 11:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f10d7e07-2d9b-5fc3-af76-43281d86d1cc with scrape type 2
2026-03-28 11:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f10d7e07-2d9b-5fc3-af76-43281d86d1cc, identifier: XH60803
2026-03-28 11:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803
2026-03-28 11:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803
2026-03-28 11:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f10d7e07-2d9b-5fc3-af76-43281d86d1cc with identifier: XH60803 to the API
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:20Z',
 'fuel_type': 'diesel',
 'id': 'f10d7e07-2d9b-5fc3-af76-43281d86d1cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH60803',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 265844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-28 11:08:27 [auto1.de] INFO: Saving data for XH60803: {'auction_closing_time': 1774713740.0, 'created_time': 1774034973.94635, 'last_price_update_time': 1774696107.25708}
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH60803') HTTP/1.1" 204 0
2026-03-28 11:08:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:27 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-28 11:08:27 [auto1.de] INFO: Scrape type for KH20562: 2
2026-03-28 11:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562
2026-03-28 11:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e22452bb-7a4a-5b55-90c2-e7e48a451095 with scrape type 2
2026-03-28 11:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e22452bb-7a4a-5b55-90c2-e7e48a451095 with scrape type 2
2026-03-28 11:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e22452bb-7a4a-5b55-90c2-e7e48a451095, identifier: KH20562
2026-03-28 11:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562
2026-03-28 11:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562
2026-03-28 11:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e22452bb-7a4a-5b55-90c2-e7e48a451095 with identifier: KH20562 to the API
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:40:15Z',
 'fuel_type': 'petrol',
 'id': 'e22452bb-7a4a-5b55-90c2-e7e48a451095',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH20562',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 107445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-28 11:08:27 [auto1.de] INFO: Saving data for KH20562: {'auction_closing_time': 1774716015.0, 'created_time': 1773341572.003589, 'last_price_update_time': 1774696107.727669}
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH20562') HTTP/1.1" 204 0
2026-03-28 11:08:27 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-28 11:08:27 [auto1.de] INFO: Scrape type for KH96137: 2
2026-03-28 11:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137
2026-03-28 11:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ee910bd-65a1-582f-bd5e-7f6162d01902 with scrape type 2
2026-03-28 11:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ee910bd-65a1-582f-bd5e-7f6162d01902 with scrape type 2
2026-03-28 11:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ee910bd-65a1-582f-bd5e-7f6162d01902, identifier: KH96137
2026-03-28 11:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137
2026-03-28 11:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137
2026-03-28 11:08:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ee910bd-65a1-582f-bd5e-7f6162d01902 with identifier: KH96137 to the API
2026-03-28 11:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:59:27Z',
 'fuel_type': 'diesel',
 'id': '7ee910bd-65a1-582f-bd5e-7f6162d01902',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH96137',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 224096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi 360',
 'transmission': 'automatic',
 'trim': '360',
 'year': 2015}
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.de] INFO: Saving data for KH96137: {'auction_closing_time': 1774717167.0, 'created_time': 1773830580.958743, 'last_price_update_time': 1774696108.129673}
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH96137') HTTP/1.1" 204 0
2026-03-28 11:08:28 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-28 11:08:28 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-28 11:08:28 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-28 11:08:28 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-28 11:08:28 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-28 11:08:28 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.de] INFO: Scrape type for CJ94642: 2
2026-03-28 11:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642
2026-03-28 11:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6782bfd-9371-5a5e-9668-335f14764b8a with scrape type 2
2026-03-28 11:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6782bfd-9371-5a5e-9668-335f14764b8a with scrape type 2
2026-03-28 11:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6782bfd-9371-5a5e-9668-335f14764b8a, identifier: CJ94642
2026-03-28 11:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642
2026-03-28 11:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642
2026-03-28 11:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6782bfd-9371-5a5e-9668-335f14764b8a with identifier: CJ94642 to the API
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:49:42Z',
 'fuel_type': 'diesel',
 'id': 'd6782bfd-9371-5a5e-9668-335f14764b8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ94642',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 217323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-06',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2011}
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.de] INFO: Saving data for CJ94642: {'auction_closing_time': 1774716582.0, 'created_time': 1773688146.343724, 'last_price_update_time': 1774696108.513337}
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ94642') HTTP/1.1" 204 0
2026-03-28 11:08:28 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.de] INFO: Scrape type for SD45668: 2
2026-03-28 11:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668
2026-03-28 11:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71046146-e93c-553f-b627-7916516e0c27 with scrape type 2
2026-03-28 11:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71046146-e93c-553f-b627-7916516e0c27 with scrape type 2
2026-03-28 11:08:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71046146-e93c-553f-b627-7916516e0c27, identifier: SD45668
2026-03-28 11:08:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668
2026-03-28 11:08:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668
2026-03-28 11:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71046146-e93c-553f-b627-7916516e0c27 with identifier: SD45668 to the API
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:00:27Z',
 'fuel_type': 'diesel',
 'id': '71046146-e93c-553f-b627-7916516e0c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD45668',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 230322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CDI T BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2010}
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.de] INFO: Saving data for SD45668: {'auction_closing_time': 1774713627.0, 'created_time': 1773646538.524547, 'last_price_update_time': 1774696108.898555}
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD45668') HTTP/1.1" 204 0
2026-03-28 11:08:28 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-28 11:08:28 [auto1.de] INFO: Scrape type for FX08537: 2
2026-03-28 11:08:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537
2026-03-28 11:08:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with scrape type 2
2026-03-28 11:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with scrape type 2
2026-03-28 11:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2, identifier: FX08537
2026-03-28 11:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537
2026-03-28 11:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537
2026-03-28 11:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2 with identifier: FX08537 to the API
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:24:15Z',
 'fuel_type': 'diesel',
 'id': 'fe4f0857-2b4c-5f4f-9b1f-17098be3dfc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX08537',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 211393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.7 CRDi Style blue 2WD',
 'transmission': 'automatic',
 'trim': 'Style blue 2WD',
 'year': 2017}
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-28 11:08:29 [auto1.de] INFO: Saving data for FX08537: {'auction_closing_time': 1774715055.0, 'created_time': 1774292788.054162, 'last_price_update_time': 1774696109.323798}
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX08537') HTTP/1.1" 204 0
2026-03-28 11:08:29 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-28 11:08:29 [auto1.de] INFO: Scrape type for CE85756: 2
2026-03-28 11:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756
2026-03-28 11:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with scrape type 2
2026-03-28 11:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with scrape type 2
2026-03-28 11:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0, identifier: CE85756
2026-03-28 11:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756
2026-03-28 11:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756
2026-03-28 11:08:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a9fb5c-4305-5cbe-a28b-6748434ca9a0 with identifier: CE85756 to the API
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:25:30Z',
 'fuel_type': 'petrol',
 'id': 'b7a9fb5c-4305-5cbe-a28b-6748434ca9a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE85756',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 28024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-23',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Go',
 'transmission': 'manual',
 'trim': 'Go',
 'year': 2017}
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-28 11:08:29 [auto1.de] INFO: Saving data for CE85756: {'auction_closing_time': 1774715130.0, 'created_time': 1774608016.406347, 'last_price_update_time': 1774696109.777092}
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE85756') HTTP/1.1" 204 0
2026-03-28 11:08:29 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-28 11:08:29 [auto1.de] INFO: Scrape type for SF33056: 2
2026-03-28 11:08:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056
2026-03-28 11:08:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 888b1695-1cc5-5889-b6b7-4445200e45b4 with scrape type 2
2026-03-28 11:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 888b1695-1cc5-5889-b6b7-4445200e45b4 with scrape type 2
2026-03-28 11:08:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 888b1695-1cc5-5889-b6b7-4445200e45b4, identifier: SF33056
2026-03-28 11:08:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056
2026-03-28 11:08:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056
2026-03-28 11:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 888b1695-1cc5-5889-b6b7-4445200e45b4 with identifier: SF33056 to the API
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:23:57Z',
 'fuel_type': 'petrol',
 'id': '888b1695-1cc5-5889-b6b7-4445200e45b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF33056',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 40286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-07',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2012}
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.de] INFO: Saving data for SF33056: {'auction_closing_time': 1774715037.0, 'created_time': 1773302822.228211, 'last_price_update_time': 1774696110.267084}
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF33056') HTTP/1.1" 204 0
2026-03-28 11:08:30 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-28 11:08:30 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-28 11:08:30 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.de] INFO: Scrape type for BG81908: 2
2026-03-28 11:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908
2026-03-28 11:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with scrape type 2
2026-03-28 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with scrape type 2
2026-03-28 11:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1582a76a-7768-5657-bbaa-47d7cb91b1e1, identifier: BG81908
2026-03-28 11:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908
2026-03-28 11:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908
2026-03-28 11:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1582a76a-7768-5657-bbaa-47d7cb91b1e1 with identifier: BG81908 to the API
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:53Z',
 'fuel_type': 'petrol',
 'id': '1582a76a-7768-5657-bbaa-47d7cb91b1e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG81908',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 6474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2022}
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.de] INFO: Saving data for BG81908: {'auction_closing_time': 1774716173.0, 'created_time': 1774294694.658125, 'last_price_update_time': 1774696110.669418}
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG81908') HTTP/1.1" 204 0
2026-03-28 11:08:30 [auto1.de] INFO: Found listing with ID: BG14243
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG14243%27 HTTP/1.1" 200 None
2026-03-28 11:08:30 [auto1.de] INFO: Scrape type for BG14243: 2
2026-03-28 11:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with identifier: BG14243
2026-03-28 11:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with scrape type 2
2026-03-28 11:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with scrape type 2
2026-03-28 11:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce, identifier: BG14243
2026-03-28 11:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with identifier: BG14243
2026-03-28 11:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with identifier: BG14243
2026-03-28 11:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c42063c-1d88-5c02-b4ba-e1fb1838ffce with identifier: BG14243 to the API
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-28T16:43:06Z',
 'fuel_type': 'petrol',
 'id': '2c42063c-1d88-5c02-b4ba-e1fb1838ffce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG14243',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 92563,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-13',
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2016}
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG14243%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.de] INFO: Saving data for BG14243: {'auction_closing_time': 1774716186.0, 'created_time': 1774293982.656612, 'last_price_update_time': 1774696111.302046}
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG14243') HTTP/1.1" 204 0
2026-03-28 11:08:31 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-28 11:08:31 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-28 11:08:31 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-28 11:08:31 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.de] INFO: Scrape type for DF93652: 2
2026-03-28 11:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652
2026-03-28 11:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with scrape type 2
2026-03-28 11:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with scrape type 2
2026-03-28 11:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab, identifier: DF93652
2026-03-28 11:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652
2026-03-28 11:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652
2026-03-28 11:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45e1a13a-53bc-5f5c-8dce-3fa9de323dab with identifier: DF93652 to the API
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:46:39Z',
 'fuel_type': 'petrol',
 'id': '45e1a13a-53bc-5f5c-8dce-3fa9de323dab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF93652',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 174284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-13',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.de] INFO: Saving data for DF93652: {'auction_closing_time': 1774716399.0, 'created_time': 1774293735.382538, 'last_price_update_time': 1774696111.709146}
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF93652') HTTP/1.1" 204 0
2026-03-28 11:08:31 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-28 11:08:31 [auto1.de] INFO: Scrape type for HV25811: 2
2026-03-28 11:08:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811
2026-03-28 11:08:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67d37d4-9e1d-59fb-be68-efdf59c28486 with scrape type 2
2026-03-28 11:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a67d37d4-9e1d-59fb-be68-efdf59c28486 with scrape type 2
2026-03-28 11:08:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a67d37d4-9e1d-59fb-be68-efdf59c28486, identifier: HV25811
2026-03-28 11:08:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811
2026-03-28 11:08:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811
2026-03-28 11:08:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a67d37d4-9e1d-59fb-be68-efdf59c28486 with identifier: HV25811 to the API
2026-03-28 11:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:54:28Z',
 'fuel_type': 'diesel',
 'id': 'a67d37d4-9e1d-59fb-be68-efdf59c28486',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV25811',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 194886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-10',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 TDCi Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.de] INFO: Saving data for HV25811: {'auction_closing_time': 1774716868.0, 'created_time': 1773861037.372869, 'last_price_update_time': 1774696112.143036}
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV25811') HTTP/1.1" 204 0
2026-03-28 11:08:32 [auto1.de] INFO: Found listing with ID: CA31330
2026-03-28 11:08:32 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-28 11:08:32 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-28 11:08:32 [auto1.de] INFO: Scrape type for XT97786: 2
2026-03-28 11:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786
2026-03-28 11:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6facd69-7e21-50c3-9f3f-9f041ea4f94b with scrape type 2
2026-03-28 11:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6facd69-7e21-50c3-9f3f-9f041ea4f94b with scrape type 2
2026-03-28 11:08:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6facd69-7e21-50c3-9f3f-9f041ea4f94b, identifier: XT97786
2026-03-28 11:08:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786
2026-03-28 11:08:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786
2026-03-28 11:08:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6facd69-7e21-50c3-9f3f-9f041ea4f94b with identifier: XT97786 to the API
2026-03-28 11:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:18:14Z',
 'fuel_type': 'diesel',
 'id': 'b6facd69-7e21-50c3-9f3f-9f041ea4f94b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT97786',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 161110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-04',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.de] INFO: Saving data for XT97786: {'auction_closing_time': 1774714694.0, 'created_time': 1773304551.431809, 'last_price_update_time': 1774696113.145778}
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT97786') HTTP/1.1" 204 0
2026-03-28 11:08:33 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-28 11:08:33 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-28 11:08:33 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-28 11:08:33 [auto1.de] INFO: Found listing with ID: NW54336
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW54336%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.de] INFO: Scrape type for NW54336: 2
2026-03-28 11:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: NW54336
2026-03-28 11:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51273f1e-8e51-5a24-afab-3768a127c295 with scrape type 2
2026-03-28 11:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51273f1e-8e51-5a24-afab-3768a127c295 with scrape type 2
2026-03-28 11:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51273f1e-8e51-5a24-afab-3768a127c295, identifier: NW54336
2026-03-28 11:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: NW54336
2026-03-28 11:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: NW54336
2026-03-28 11:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51273f1e-8e51-5a24-afab-3768a127c295 with identifier: NW54336 to the API
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:17:23Z',
 'fuel_type': 'electro',
 'id': '51273f1e-8e51-5a24-afab-3768a127c295',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW54336',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 12,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-18',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW54336%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.de] INFO: Saving data for NW54336: {'auction_closing_time': 1774714643.0, 'created_time': 1774608007.139317, 'last_price_update_time': 1774696113.688168}
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW54336') HTTP/1.1" 204 0
2026-03-28 11:08:33 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-28 11:08:33 [auto1.de] INFO: Scrape type for PS82435: 2
2026-03-28 11:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435
2026-03-28 11:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d46900-c4d0-596f-bf3c-3292316c6c06 with scrape type 2
2026-03-28 11:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d46900-c4d0-596f-bf3c-3292316c6c06 with scrape type 2
2026-03-28 11:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83d46900-c4d0-596f-bf3c-3292316c6c06, identifier: PS82435
2026-03-28 11:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435
2026-03-28 11:08:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435
2026-03-28 11:08:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83d46900-c4d0-596f-bf3c-3292316c6c06 with identifier: PS82435 to the API
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:30:31Z',
 'fuel_type': 'diesel',
 'id': '83d46900-c4d0-596f-bf3c-3292316c6c06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS82435',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 111544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.de] INFO: Saving data for PS82435: {'auction_closing_time': 1774715431.0, 'created_time': 1773383897.094769, 'last_price_update_time': 1774696114.116205}
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS82435') HTTP/1.1" 204 0
2026-03-28 11:08:34 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.de] INFO: Scrape type for HD83134: 2
2026-03-28 11:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134
2026-03-28 11:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 775d625a-b63d-5158-8a4d-ab299b317418 with scrape type 2
2026-03-28 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 775d625a-b63d-5158-8a4d-ab299b317418 with scrape type 2
2026-03-28 11:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 775d625a-b63d-5158-8a4d-ab299b317418, identifier: HD83134
2026-03-28 11:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134
2026-03-28 11:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134
2026-03-28 11:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 775d625a-b63d-5158-8a4d-ab299b317418 with identifier: HD83134 to the API
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:56:42Z',
 'fuel_type': 'diesel',
 'id': '775d625a-b63d-5158-8a4d-ab299b317418',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD83134',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 127808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-22',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Feel M',
 'transmission': 'automatic',
 'trim': 'Feel M',
 'year': 2018}
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.de] INFO: Saving data for HD83134: {'auction_closing_time': 1774717002.0, 'created_time': 1773743753.185873, 'last_price_update_time': 1774696114.519535}
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD83134') HTTP/1.1" 204 0
2026-03-28 11:08:34 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-28 11:08:34 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.de] INFO: Scrape type for BK83629: 2
2026-03-28 11:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629
2026-03-28 11:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b99433-4430-572a-bf83-d3422960a74c with scrape type 2
2026-03-28 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08b99433-4430-572a-bf83-d3422960a74c with scrape type 2
2026-03-28 11:08:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08b99433-4430-572a-bf83-d3422960a74c, identifier: BK83629
2026-03-28 11:08:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629
2026-03-28 11:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629
2026-03-28 11:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08b99433-4430-572a-bf83-d3422960a74c with identifier: BK83629 to the API
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:37:25Z',
 'fuel_type': 'diesel',
 'id': '08b99433-4430-572a-bf83-d3422960a74c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK83629',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 247105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-25',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.de] INFO: Saving data for BK83629: {'auction_closing_time': 1774715845.0, 'created_time': 1773775072.915129, 'last_price_update_time': 1774696114.921073}
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK83629') HTTP/1.1" 204 0
2026-03-28 11:08:34 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-28 11:08:34 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-28 11:08:34 [auto1.de] INFO: Scrape type for EL68687: 2
2026-03-28 11:08:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687
2026-03-28 11:08:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36584fe8-f12d-5dab-b9be-feec72cec099 with scrape type 2
2026-03-28 11:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36584fe8-f12d-5dab-b9be-feec72cec099 with scrape type 2
2026-03-28 11:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36584fe8-f12d-5dab-b9be-feec72cec099, identifier: EL68687
2026-03-28 11:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687
2026-03-28 11:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687
2026-03-28 11:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36584fe8-f12d-5dab-b9be-feec72cec099 with identifier: EL68687 to the API
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:22:23Z',
 'fuel_type': 'petrol',
 'id': '36584fe8-f12d-5dab-b9be-feec72cec099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL68687',
 'listing': 'auction',
 'make': 'Lada',
 'model': 'Kalina 2',
 'odometer': 113754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Lada Kalina 2 1.6 Luxus',
 'transmission': 'manual',
 'trim': 'Luxus',
 'year': 2018}
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-28 11:08:35 [auto1.de] INFO: Saving data for EL68687: {'auction_closing_time': 1774714943.0, 'created_time': 1774290939.72187, 'last_price_update_time': 1774696115.3201}
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL68687') HTTP/1.1" 204 0
2026-03-28 11:08:35 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-28 11:08:35 [auto1.de] INFO: Scrape type for ZS15843: 2
2026-03-28 11:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843
2026-03-28 11:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957f701b-78c6-5a1a-bce4-b900c77f25bc with scrape type 2
2026-03-28 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957f701b-78c6-5a1a-bce4-b900c77f25bc with scrape type 2
2026-03-28 11:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 957f701b-78c6-5a1a-bce4-b900c77f25bc, identifier: ZS15843
2026-03-28 11:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843
2026-03-28 11:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843
2026-03-28 11:08:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 957f701b-78c6-5a1a-bce4-b900c77f25bc with identifier: ZS15843 to the API
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:10:34Z',
 'fuel_type': 'diesel',
 'id': '957f701b-78c6-5a1a-bce4-b900c77f25bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS15843',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 129072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-01',
 'seller_name': None,
 'title': 'BMW X3 xDrive 25d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-28 11:08:35 [auto1.de] INFO: Saving data for ZS15843: {'auction_closing_time': 1774714234.0, 'created_time': 1773830242.553052, 'last_price_update_time': 1774696115.725456}
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS15843') HTTP/1.1" 204 0
2026-03-28 11:08:35 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-28 11:08:35 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-28 11:08:35 [auto1.de] INFO: Scrape type for XE19125: 2
2026-03-28 11:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125
2026-03-28 11:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b186d73a-d055-5875-a0cd-f9c620e51bbc with scrape type 2
2026-03-28 11:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b186d73a-d055-5875-a0cd-f9c620e51bbc with scrape type 2
2026-03-28 11:08:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b186d73a-d055-5875-a0cd-f9c620e51bbc, identifier: XE19125
2026-03-28 11:08:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125
2026-03-28 11:08:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125
2026-03-28 11:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b186d73a-d055-5875-a0cd-f9c620e51bbc with identifier: XE19125 to the API
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:42Z',
 'fuel_type': 'diesel',
 'id': 'b186d73a-d055-5875-a0cd-f9c620e51bbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE19125',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 168849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-28',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Active Plus Edition',
 'transmission': 'manual',
 'trim': 'Active Plus Edition',
 'year': 2013}
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.de] INFO: Saving data for XE19125: {'auction_closing_time': 1774715202.0, 'created_time': 1774293395.749275, 'last_price_update_time': 1774696116.272575}
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE19125') HTTP/1.1" 204 0
2026-03-28 11:08:36 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-28 11:08:36 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-28 11:08:36 [auto1.de] INFO: Scrape type for DG34410: 2
2026-03-28 11:08:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410
2026-03-28 11:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32396ce5-c841-5787-9313-5ee60592a2c4 with scrape type 2
2026-03-28 11:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32396ce5-c841-5787-9313-5ee60592a2c4 with scrape type 2
2026-03-28 11:08:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32396ce5-c841-5787-9313-5ee60592a2c4, identifier: DG34410
2026-03-28 11:08:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410
2026-03-28 11:08:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410
2026-03-28 11:08:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32396ce5-c841-5787-9313-5ee60592a2c4 with identifier: DG34410 to the API
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:02:24Z',
 'fuel_type': 'petrol',
 'id': '32396ce5-c841-5787-9313-5ee60592a2c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG34410',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 105777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2016}
2026-03-28 11:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-28 11:08:37 [auto1.de] INFO: Saving data for DG34410: {'auction_closing_time': 1774713744.0, 'created_time': 1774262886.678608, 'last_price_update_time': 1774696117.047813}
2026-03-28 11:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG34410') HTTP/1.1" 204 0
2026-03-28 11:08:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:40 [auto1.de] INFO: Channel: 24h | Page: 207 | totalHits: 9705 | hits on page: 40
2026-03-28 11:08:40 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-28 11:08:40 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-28 11:08:40 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.de] INFO: Scrape type for CY33039: 2
2026-03-28 11:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039
2026-03-28 11:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57a3b39f-620e-5e34-af76-592760220052 with scrape type 2
2026-03-28 11:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57a3b39f-620e-5e34-af76-592760220052 with scrape type 2
2026-03-28 11:08:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57a3b39f-620e-5e34-af76-592760220052, identifier: CY33039
2026-03-28 11:08:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039
2026-03-28 11:08:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039
2026-03-28 11:08:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57a3b39f-620e-5e34-af76-592760220052 with identifier: CY33039 to the API
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:08:05Z',
 'fuel_type': 'petrol',
 'id': '57a3b39f-620e-5e34-af76-592760220052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY33039',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 219827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2013}
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.de] INFO: Saving data for CY33039: {'auction_closing_time': 1774714085.0, 'created_time': 1774262936.886555, 'last_price_update_time': 1774696120.955704}
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY33039') HTTP/1.1" 204 0
2026-03-28 11:08:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:40 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-28 11:08:40 [auto1.de] INFO: Scrape type for YJ51408: 2
2026-03-28 11:08:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408
2026-03-28 11:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with scrape type 2
2026-03-28 11:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with scrape type 2
2026-03-28 11:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0, identifier: YJ51408
2026-03-28 11:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408
2026-03-28 11:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408
2026-03-28 11:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99e4a30f-26f4-5199-8aea-c26cfbeb21f0 with identifier: YJ51408 to the API
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:46:57Z',
 'fuel_type': 'diesel',
 'id': '99e4a30f-26f4-5199-8aea-c26cfbeb21f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ51408',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 196247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-19',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-28 11:08:41 [auto1.de] INFO: Saving data for YJ51408: {'auction_closing_time': 1774716417.0, 'created_time': 1774293333.078668, 'last_price_update_time': 1774696121.39707}
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ51408') HTTP/1.1" 204 0
2026-03-28 11:08:41 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-28 11:08:41 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-28 11:08:41 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-28 11:08:41 [auto1.de] INFO: Scrape type for AG88480: 2
2026-03-28 11:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480
2026-03-28 11:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 858c7846-9150-55e7-a719-a197d896567e with scrape type 2
2026-03-28 11:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 858c7846-9150-55e7-a719-a197d896567e with scrape type 2
2026-03-28 11:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 858c7846-9150-55e7-a719-a197d896567e, identifier: AG88480
2026-03-28 11:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480
2026-03-28 11:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480
2026-03-28 11:08:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 858c7846-9150-55e7-a719-a197d896567e with identifier: AG88480 to the API
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:38:05Z',
 'fuel_type': 'diesel',
 'id': '858c7846-9150-55e7-a719-a197d896567e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG88480',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 204182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-05',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-28 11:08:41 [auto1.de] INFO: Saving data for AG88480: {'auction_closing_time': 1774715885.0, 'created_time': 1773861288.338836, 'last_price_update_time': 1774696121.812623}
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG88480') HTTP/1.1" 204 0
2026-03-28 11:08:41 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-28 11:08:41 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-28 11:08:41 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-28 11:08:41 [auto1.de] INFO: Scrape type for XU55815: 2
2026-03-28 11:08:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815
2026-03-28 11:08:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f446d91-50e7-5bc0-934f-0bf01935e8df with scrape type 2
2026-03-28 11:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f446d91-50e7-5bc0-934f-0bf01935e8df with scrape type 2
2026-03-28 11:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f446d91-50e7-5bc0-934f-0bf01935e8df, identifier: XU55815
2026-03-28 11:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815
2026-03-28 11:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815
2026-03-28 11:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f446d91-50e7-5bc0-934f-0bf01935e8df with identifier: XU55815 to the API
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:24:52Z',
 'fuel_type': 'diesel',
 'id': '3f446d91-50e7-5bc0-934f-0bf01935e8df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU55815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 198988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Lounge Sport & Style 4Motion BlueMotion',
 'year': 2015}
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.de] INFO: Saving data for XU55815: {'auction_closing_time': 1774715092.0, 'created_time': 1773861341.399962, 'last_price_update_time': 1774696122.317604}
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU55815') HTTP/1.1" 204 0
2026-03-28 11:08:42 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.de] INFO: Scrape type for PB28144: 2
2026-03-28 11:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144
2026-03-28 11:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with scrape type 2
2026-03-28 11:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with scrape type 2
2026-03-28 11:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7628a106-4bdd-5030-a8f2-12f1a7c24f90, identifier: PB28144
2026-03-28 11:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144
2026-03-28 11:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144
2026-03-28 11:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7628a106-4bdd-5030-a8f2-12f1a7c24f90 with identifier: PB28144 to the API
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-28T16:01:25Z',
 'fuel_type': 'petrol',
 'id': '7628a106-4bdd-5030-a8f2-12f1a7c24f90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB28144',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 147726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-27',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Edition 2WD',
 'transmission': 'manual',
 'trim': 'Edition 2WD',
 'year': 2014}
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.de] INFO: Saving data for PB28144: {'auction_closing_time': 1774713685.0, 'created_time': 1773555375.668089, 'last_price_update_time': 1774696122.736931}
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB28144') HTTP/1.1" 204 0
2026-03-28 11:08:42 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-28 11:08:42 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-28 11:08:42 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-28 11:08:42 [auto1.de] INFO: Scrape type for RJ10234: 2
2026-03-28 11:08:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234
2026-03-28 11:08:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2ed279-1c7c-5855-be48-0f7a527b1e0d with scrape type 2
2026-03-28 11:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2ed279-1c7c-5855-be48-0f7a527b1e0d with scrape type 2
2026-03-28 11:08:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd2ed279-1c7c-5855-be48-0f7a527b1e0d, identifier: RJ10234
2026-03-28 11:08:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234
2026-03-28 11:08:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234
2026-03-28 11:08:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd2ed279-1c7c-5855-be48-0f7a527b1e0d with identifier: RJ10234 to the API
2026-03-28 11:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:27:21Z',
 'fuel_type': 'petrol',
 'id': 'dd2ed279-1c7c-5855-be48-0f7a527b1e0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ10234',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 21540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-27',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2024}
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.de] INFO: Saving data for RJ10234: {'auction_closing_time': 1774715241.0, 'created_time': 1773304642.434631, 'last_price_update_time': 1774696123.140964}
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ10234') HTTP/1.1" 204 0
2026-03-28 11:08:43 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-28 11:08:43 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-28 11:08:43 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-28 11:08:43 [auto1.de] INFO: Found listing with ID: UH98886
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98886%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.de] INFO: Scrape type for UH98886: 2
2026-03-28 11:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a319550-5d85-5f28-824e-6f9be8d2f892 with identifier: UH98886
2026-03-28 11:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a319550-5d85-5f28-824e-6f9be8d2f892 with scrape type 2
2026-03-28 11:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a319550-5d85-5f28-824e-6f9be8d2f892 with scrape type 2
2026-03-28 11:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a319550-5d85-5f28-824e-6f9be8d2f892, identifier: UH98886
2026-03-28 11:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a319550-5d85-5f28-824e-6f9be8d2f892 with identifier: UH98886
2026-03-28 11:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a319550-5d85-5f28-824e-6f9be8d2f892 with identifier: UH98886
2026-03-28 11:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a319550-5d85-5f28-824e-6f9be8d2f892 with identifier: UH98886 to the API
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:22Z',
 'fuel_type': 'petrol',
 'id': '9a319550-5d85-5f28-824e-6f9be8d2f892',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH98886',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 147857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH98886%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.de] INFO: Saving data for UH98886: {'auction_closing_time': 1774714522.0, 'created_time': 1774608038.872887, 'last_price_update_time': 1774696123.536321}
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH98886') HTTP/1.1" 204 0
2026-03-28 11:08:43 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-28 11:08:43 [auto1.de] INFO: Found listing with ID: HW66490
2026-03-28 11:08:43 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-28 11:08:43 [auto1.de] INFO: Found listing with ID: NV75211
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV75211%27 HTTP/1.1" 200 None
2026-03-28 11:08:43 [auto1.de] INFO: Scrape type for NV75211: 2
2026-03-28 11:08:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac15e28-8e54-5284-9efa-765b93e1ede7 with identifier: NV75211
2026-03-28 11:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac15e28-8e54-5284-9efa-765b93e1ede7 with scrape type 2
2026-03-28 11:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac15e28-8e54-5284-9efa-765b93e1ede7 with scrape type 2
2026-03-28 11:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ac15e28-8e54-5284-9efa-765b93e1ede7, identifier: NV75211
2026-03-28 11:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ac15e28-8e54-5284-9efa-765b93e1ede7 with identifier: NV75211
2026-03-28 11:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ac15e28-8e54-5284-9efa-765b93e1ede7 with identifier: NV75211
2026-03-28 11:08:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ac15e28-8e54-5284-9efa-765b93e1ede7 with identifier: NV75211 to the API
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:51:41Z',
 'fuel_type': 'petrol',
 'id': '8ac15e28-8e54-5284-9efa-765b93e1ede7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV75211',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 148562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV75211%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.de] INFO: Saving data for NV75211: {'auction_closing_time': 1774716701.0, 'created_time': 1774263448.460566, 'last_price_update_time': 1774696124.033311}
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV75211') HTTP/1.1" 204 0
2026-03-28 11:08:44 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-28 11:08:44 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.de] INFO: Scrape type for HX66232: 2
2026-03-28 11:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232
2026-03-28 11:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with scrape type 2
2026-03-28 11:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with scrape type 2
2026-03-28 11:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e, identifier: HX66232
2026-03-28 11:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232
2026-03-28 11:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232
2026-03-28 11:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08bd7200-f9fb-57ab-9d1a-3f8497e28f1e with identifier: HX66232 to the API
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:27:44Z',
 'fuel_type': 'petrol',
 'id': '08bd7200-f9fb-57ab-9d1a-3f8497e28f1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX66232',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 167261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-26',
 'seller_name': None,
 'title': 'Seat Leon 1.6 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2007}
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.de] INFO: Saving data for HX66232: {'auction_closing_time': 1774715264.0, 'created_time': 1773772791.720956, 'last_price_update_time': 1774696124.45746}
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX66232') HTTP/1.1" 204 0
2026-03-28 11:08:44 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.de] INFO: Scrape type for CS56497: 2
2026-03-28 11:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497
2026-03-28 11:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with scrape type 2
2026-03-28 11:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with scrape type 2
2026-03-28 11:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d, identifier: CS56497
2026-03-28 11:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497
2026-03-28 11:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497
2026-03-28 11:08:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d with identifier: CS56497 to the API
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:57:36Z',
 'fuel_type': 'diesel',
 'id': 'ea3bcdef-a30d-5cd5-aea9-ef795b47ed3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS56497',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 98752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-12',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.2 JTDM Q4 Lusso',
 'transmission': 'automatic',
 'trim': 'Q4 Lusso',
 'year': 2020}
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.de] INFO: Saving data for CS56497: {'auction_closing_time': 1774717056.0, 'created_time': 1774291223.832113, 'last_price_update_time': 1774696124.855871}
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS56497') HTTP/1.1" 204 0
2026-03-28 11:08:44 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-28 11:08:44 [auto1.de] INFO: Scrape type for AM15816: 2
2026-03-28 11:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816
2026-03-28 11:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c7c327-8ad4-501a-87c8-8ea9167146f9 with scrape type 2
2026-03-28 11:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3c7c327-8ad4-501a-87c8-8ea9167146f9 with scrape type 2
2026-03-28 11:08:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3c7c327-8ad4-501a-87c8-8ea9167146f9, identifier: AM15816
2026-03-28 11:08:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816
2026-03-28 11:08:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816
2026-03-28 11:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3c7c327-8ad4-501a-87c8-8ea9167146f9 with identifier: AM15816 to the API
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:52:17Z',
 'fuel_type': 'petrol',
 'id': 'a3c7c327-8ad4-501a-87c8-8ea9167146f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM15816',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 182668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-19',
 'seller_name': None,
 'title': 'Suzuki SX4 1.5 Streetline Classic',
 'transmission': 'manual',
 'trim': 'Streetline Classic',
 'year': 2009}
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-28 11:08:45 [auto1.de] INFO: Saving data for AM15816: {'auction_closing_time': 1774716737.0, 'created_time': 1774293061.861027, 'last_price_update_time': 1774696125.289339}
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM15816') HTTP/1.1" 204 0
2026-03-28 11:08:45 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-28 11:08:45 [auto1.de] INFO: Scrape type for RJ47669: 2
2026-03-28 11:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669
2026-03-28 11:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78100c6e-4e2d-58f3-bcc4-183a44130648 with scrape type 2
2026-03-28 11:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78100c6e-4e2d-58f3-bcc4-183a44130648 with scrape type 2
2026-03-28 11:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78100c6e-4e2d-58f3-bcc4-183a44130648, identifier: RJ47669
2026-03-28 11:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669
2026-03-28 11:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669
2026-03-28 11:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78100c6e-4e2d-58f3-bcc4-183a44130648 with identifier: RJ47669 to the API
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:55:55Z',
 'fuel_type': 'petrol',
 'id': '78100c6e-4e2d-58f3-bcc4-183a44130648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ47669',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 182184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-17',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2011}
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-28 11:08:45 [auto1.de] INFO: Saving data for RJ47669: {'auction_closing_time': 1774716955.0, 'created_time': 1773830401.654902, 'last_price_update_time': 1774696125.703733}
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ47669') HTTP/1.1" 204 0
2026-03-28 11:08:45 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-28 11:08:45 [auto1.de] INFO: Found listing with ID: JU74172
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU74172%27 HTTP/1.1" 200 None
2026-03-28 11:08:45 [auto1.de] INFO: Scrape type for JU74172: 2
2026-03-28 11:08:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5256a6c5-b8ff-5574-87c3-fc726db79b21 with identifier: JU74172
2026-03-28 11:08:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5256a6c5-b8ff-5574-87c3-fc726db79b21 with scrape type 2
2026-03-28 11:08:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5256a6c5-b8ff-5574-87c3-fc726db79b21 with scrape type 2
2026-03-28 11:08:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5256a6c5-b8ff-5574-87c3-fc726db79b21, identifier: JU74172
2026-03-28 11:08:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5256a6c5-b8ff-5574-87c3-fc726db79b21 with identifier: JU74172
2026-03-28 11:08:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5256a6c5-b8ff-5574-87c3-fc726db79b21 with identifier: JU74172
2026-03-28 11:08:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5256a6c5-b8ff-5574-87c3-fc726db79b21 with identifier: JU74172 to the API
2026-03-28 11:08:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:55:39Z',
 'fuel_type': 'diesel',
 'id': '5256a6c5-b8ff-5574-87c3-fc726db79b21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU74172',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 55424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-10',
 'seller_name': None,
 'title': 'Volvo V90 2.0 B4 Mild-Hybrid R Design AWD',
 'transmission': 'automatic',
 'trim': 'R Design AWD',
 'year': 2023}
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU74172%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.de] INFO: Saving data for JU74172: {'auction_closing_time': 1774716939.0, 'created_time': 1774293543.250006, 'last_price_update_time': 1774696126.144542}
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU74172') HTTP/1.1" 204 0
2026-03-28 11:08:46 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.de] INFO: Scrape type for MZ82429: 2
2026-03-28 11:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429
2026-03-28 11:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with scrape type 2
2026-03-28 11:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with scrape type 2
2026-03-28 11:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1, identifier: MZ82429
2026-03-28 11:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429
2026-03-28 11:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429
2026-03-28 11:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 743b2873-ad5e-50b7-b75d-7ce5fa0325e1 with identifier: MZ82429 to the API
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 174,
 'expiration_date': '2026-03-28T16:03:09Z',
 'fuel_type': 'diesel',
 'id': '743b2873-ad5e-50b7-b75d-7ce5fa0325e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ82429',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 62985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-18',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.de] INFO: Saving data for MZ82429: {'auction_closing_time': 1774713789.0, 'created_time': 1773819352.587743, 'last_price_update_time': 1774696126.627346}
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ82429') HTTP/1.1" 204 0
2026-03-28 11:08:46 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-28 11:08:46 [auto1.de] INFO: Scrape type for GA31373: 2
2026-03-28 11:08:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373
2026-03-28 11:08:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61230e02-7fb6-5d7f-9b1d-37da11809044 with scrape type 2
2026-03-28 11:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61230e02-7fb6-5d7f-9b1d-37da11809044 with scrape type 2
2026-03-28 11:08:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61230e02-7fb6-5d7f-9b1d-37da11809044, identifier: GA31373
2026-03-28 11:08:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373
2026-03-28 11:08:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373
2026-03-28 11:08:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61230e02-7fb6-5d7f-9b1d-37da11809044 with identifier: GA31373 to the API
2026-03-28 11:08:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:55:42Z',
 'fuel_type': 'diesel',
 'id': '61230e02-7fb6-5d7f-9b1d-37da11809044',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA31373',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 157142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-24',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.de] INFO: Saving data for GA31373: {'auction_closing_time': 1774716942.0, 'created_time': 1773134997.959537, 'last_price_update_time': 1774696127.563517}
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA31373') HTTP/1.1" 204 0
2026-03-28 11:08:47 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-28 11:08:47 [auto1.de] INFO: Scrape type for YH04834: 2
2026-03-28 11:08:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834
2026-03-28 11:08:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27e89818-238b-5676-ad89-4085c1019d05 with scrape type 2
2026-03-28 11:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27e89818-238b-5676-ad89-4085c1019d05 with scrape type 2
2026-03-28 11:08:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27e89818-238b-5676-ad89-4085c1019d05, identifier: YH04834
2026-03-28 11:08:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834
2026-03-28 11:08:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834
2026-03-28 11:08:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27e89818-238b-5676-ad89-4085c1019d05 with identifier: YH04834 to the API
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:03Z',
 'fuel_type': 'petrol',
 'id': '27e89818-238b-5676-ad89-4085c1019d05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH04834',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 41555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2008}
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.de] INFO: Saving data for YH04834: {'auction_closing_time': 1774716303.0, 'created_time': 1774263797.126811, 'last_price_update_time': 1774696128.104203}
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH04834') HTTP/1.1" 204 0
2026-03-28 11:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:48 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.de] INFO: Scrape type for FL12267: 2
2026-03-28 11:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267
2026-03-28 11:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d317abd7-0a52-5f1c-9142-0091822e1c18 with scrape type 2
2026-03-28 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d317abd7-0a52-5f1c-9142-0091822e1c18 with scrape type 2
2026-03-28 11:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d317abd7-0a52-5f1c-9142-0091822e1c18, identifier: FL12267
2026-03-28 11:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267
2026-03-28 11:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267
2026-03-28 11:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d317abd7-0a52-5f1c-9142-0091822e1c18 with identifier: FL12267 to the API
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:49:02Z',
 'fuel_type': 'petrol',
 'id': 'd317abd7-0a52-5f1c-9142-0091822e1c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL12267',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 176906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-01',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.de] INFO: Saving data for FL12267: {'auction_closing_time': 1774716542.0, 'created_time': 1773303651.843904, 'last_price_update_time': 1774696128.54077}
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL12267') HTTP/1.1" 204 0
2026-03-28 11:08:48 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.de] INFO: Scrape type for WN12652: 2
2026-03-28 11:08:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652
2026-03-28 11:08:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with scrape type 2
2026-03-28 11:08:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with scrape type 2
2026-03-28 11:08:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baccaceb-0dfd-5a48-b66c-2ab35fcffa70, identifier: WN12652
2026-03-28 11:08:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652
2026-03-28 11:08:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652
2026-03-28 11:08:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baccaceb-0dfd-5a48-b66c-2ab35fcffa70 with identifier: WN12652 to the API
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:06:46Z',
 'fuel_type': 'petrol',
 'id': 'baccaceb-0dfd-5a48-b66c-2ab35fcffa70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN12652',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 50726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-27',
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-28 11:08:48 [auto1.de] INFO: Saving data for WN12652: {'auction_closing_time': 1774714006.0, 'created_time': 1773307574.059231, 'last_price_update_time': 1774696128.982582}
2026-03-28 11:08:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN12652') HTTP/1.1" 204 0
2026-03-28 11:08:49 [auto1.de] INFO: Channel: 24h | Page: 208 | totalHits: 9706 | hits on page: 40
2026-03-28 11:08:49 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.de] INFO: Scrape type for DW51780: 2
2026-03-28 11:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780
2026-03-28 11:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c653339c-9f41-5a46-b656-52162bcf9398 with scrape type 2
2026-03-28 11:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c653339c-9f41-5a46-b656-52162bcf9398 with scrape type 2
2026-03-28 11:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c653339c-9f41-5a46-b656-52162bcf9398, identifier: DW51780
2026-03-28 11:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780
2026-03-28 11:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780
2026-03-28 11:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c653339c-9f41-5a46-b656-52162bcf9398 with identifier: DW51780 to the API
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:34:38Z',
 'fuel_type': 'diesel',
 'id': 'c653339c-9f41-5a46-b656-52162bcf9398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW51780',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 266330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.de] INFO: Saving data for DW51780: {'auction_closing_time': 1774715678.0, 'created_time': 1774293394.095364, 'last_price_update_time': 1774696129.42321}
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW51780') HTTP/1.1" 204 0
2026-03-28 11:08:49 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-28 11:08:49 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.de] INFO: Scrape type for FY30353: 2
2026-03-28 11:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353
2026-03-28 11:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b3c3729-9171-5c1c-bb0d-07865d298010 with scrape type 2
2026-03-28 11:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b3c3729-9171-5c1c-bb0d-07865d298010 with scrape type 2
2026-03-28 11:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b3c3729-9171-5c1c-bb0d-07865d298010, identifier: FY30353
2026-03-28 11:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:49 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-28 11:08:49 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-28 11:08:49 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.de] INFO: Scrape type for TL66452: 2
2026-03-28 11:08:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452
2026-03-28 11:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with scrape type 2
2026-03-28 11:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with scrape type 2
2026-03-28 11:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97, identifier: TL66452
2026-03-28 11:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353
2026-03-28 11:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353
2026-03-28 11:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b3c3729-9171-5c1c-bb0d-07865d298010 with identifier: FY30353 to the API
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:36:52Z',
 'fuel_type': 'diesel',
 'id': '4b3c3729-9171-5c1c-bb0d-07865d298010',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY30353',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 181354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2010}
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-28 11:08:49 [auto1.de] INFO: Saving data for FY30353: {'auction_closing_time': 1774715812.0, 'created_time': 1773305735.967438, 'last_price_update_time': 1774696129.950715}
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY30353') HTTP/1.1" 204 0
2026-03-28 11:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452
2026-03-28 11:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452
2026-03-28 11:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d68b5eeb-0d3d-5433-97c5-03ce07cb2e97 with identifier: TL66452 to the API
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:27:58Z',
 'fuel_type': 'diesel',
 'id': 'd68b5eeb-0d3d-5433-97c5-03ce07cb2e97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL66452',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 204490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 320 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2007}
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.de] INFO: Saving data for TL66452: {'auction_closing_time': 1774715278.0, 'created_time': 1773773226.657106, 'last_price_update_time': 1774696130.399078}
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL66452') HTTP/1.1" 204 0
2026-03-28 11:08:50 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-28 11:08:50 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.de] INFO: Scrape type for DE77804: 2
2026-03-28 11:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804
2026-03-28 11:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e3b8874-fe0d-5b78-b639-10d5a47a172c with scrape type 2
2026-03-28 11:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e3b8874-fe0d-5b78-b639-10d5a47a172c with scrape type 2
2026-03-28 11:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e3b8874-fe0d-5b78-b639-10d5a47a172c, identifier: DE77804
2026-03-28 11:08:50 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.de] INFO: Scrape type for WB03477: 2
2026-03-28 11:08:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477
2026-03-28 11:08:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf68544-325e-5a0c-87b8-84dbd2136216 with scrape type 2
2026-03-28 11:08:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf68544-325e-5a0c-87b8-84dbd2136216 with scrape type 2
2026-03-28 11:08:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: daf68544-325e-5a0c-87b8-84dbd2136216, identifier: WB03477
2026-03-28 11:08:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804
2026-03-28 11:08:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804
2026-03-28 11:08:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e3b8874-fe0d-5b78-b639-10d5a47a172c with identifier: DE77804 to the API
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:32:06Z',
 'fuel_type': 'diesel',
 'id': '6e3b8874-fe0d-5b78-b639-10d5a47a172c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE77804',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 177625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-13',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 CDTI DPF Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2016}
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-28 11:08:50 [auto1.de] INFO: Saving data for DE77804: {'auction_closing_time': 1774715526.0, 'created_time': 1774294179.848863, 'last_price_update_time': 1774696130.990637}
2026-03-28 11:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE77804') HTTP/1.1" 204 0
2026-03-28 11:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477
2026-03-28 11:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477
2026-03-28 11:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: daf68544-325e-5a0c-87b8-84dbd2136216 with identifier: WB03477 to the API
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:46:07Z',
 'fuel_type': 'petrol',
 'id': 'daf68544-325e-5a0c-87b8-84dbd2136216',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB03477',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 140843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-07',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2011}
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-28 11:08:51 [auto1.de] INFO: Saving data for WB03477: {'auction_closing_time': 1774716367.0, 'created_time': 1774294751.774, 'last_price_update_time': 1774696131.369617}
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB03477') HTTP/1.1" 204 0
2026-03-28 11:08:51 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-28 11:08:51 [auto1.de] INFO: Scrape type for PZ82865: 2
2026-03-28 11:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865
2026-03-28 11:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 661c9ce5-0090-5231-9228-7a2dafd12b96 with scrape type 2
2026-03-28 11:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 661c9ce5-0090-5231-9228-7a2dafd12b96 with scrape type 2
2026-03-28 11:08:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 661c9ce5-0090-5231-9228-7a2dafd12b96, identifier: PZ82865
2026-03-28 11:08:51 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-28 11:08:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865
2026-03-28 11:08:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865
2026-03-28 11:08:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 661c9ce5-0090-5231-9228-7a2dafd12b96 with identifier: PZ82865 to the API
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 262,
 'expiration_date': '2026-03-28T16:06:44Z',
 'fuel_type': 'diesel',
 'id': '661c9ce5-0090-5231-9228-7a2dafd12b96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ82865',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 120246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-24',
 'seller_name': None,
 'title': 'Audi A8 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-28 11:08:51 [auto1.de] INFO: Saving data for PZ82865: {'auction_closing_time': 1774714004.0, 'created_time': 1774265072.591874, 'last_price_update_time': 1774696131.863041}
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ82865') HTTP/1.1" 204 0
2026-03-28 11:08:51 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-28 11:08:51 [auto1.de] INFO: Scrape type for WF80406: 2
2026-03-28 11:08:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406
2026-03-28 11:08:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af86c294-3dc1-5bf4-888f-47e35863b310 with scrape type 2
2026-03-28 11:08:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af86c294-3dc1-5bf4-888f-47e35863b310 with scrape type 2
2026-03-28 11:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af86c294-3dc1-5bf4-888f-47e35863b310, identifier: WF80406
2026-03-28 11:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406
2026-03-28 11:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406
2026-03-28 11:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af86c294-3dc1-5bf4-888f-47e35863b310 with identifier: WF80406 to the API
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:48:07Z',
 'fuel_type': 'petrol',
 'id': 'af86c294-3dc1-5bf4-888f-47e35863b310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF80406',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 66628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.5 TSI ACT sport',
 'transmission': 'automatic',
 'trim': 'sport',
 'year': 2018}
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-28 11:08:52 [auto1.de] INFO: Saving data for WF80406: {'auction_closing_time': 1774716487.0, 'created_time': 1773819327.018415, 'last_price_update_time': 1774696132.365521}
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF80406') HTTP/1.1" 204 0
2026-03-28 11:08:52 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-28 11:08:52 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-28 11:08:52 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-28 11:08:52 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-28 11:08:52 [auto1.de] INFO: Scrape type for MV18053: 2
2026-03-28 11:08:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053
2026-03-28 11:08:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 461a9b45-ae98-56f9-8454-d7329e490e6b with scrape type 2
2026-03-28 11:08:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 461a9b45-ae98-56f9-8454-d7329e490e6b with scrape type 2
2026-03-28 11:08:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 461a9b45-ae98-56f9-8454-d7329e490e6b, identifier: MV18053
2026-03-28 11:08:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053
2026-03-28 11:08:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053
2026-03-28 11:08:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 461a9b45-ae98-56f9-8454-d7329e490e6b with identifier: MV18053 to the API
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:48:37Z',
 'fuel_type': 'petrol',
 'id': '461a9b45-ae98-56f9-8454-d7329e490e6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV18053',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 115670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-03',
 'seller_name': None,
 'title': 'Audi A5 2.0 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-28 11:08:52 [auto1.de] INFO: Saving data for MV18053: {'auction_closing_time': 1774716517.0, 'created_time': 1773812125.868679, 'last_price_update_time': 1774696132.9951}
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV18053') HTTP/1.1" 204 0
2026-03-28 11:08:53 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-28 11:08:53 [auto1.de] INFO: Scrape type for SY34106: 2
2026-03-28 11:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106
2026-03-28 11:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with scrape type 2
2026-03-28 11:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with scrape type 2
2026-03-28 11:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e, identifier: SY34106
2026-03-28 11:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106
2026-03-28 11:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106
2026-03-28 11:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ab9479e-42f4-5d2d-8a4e-8256e191a47e with identifier: SY34106 to the API
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:46:18Z',
 'fuel_type': 'diesel',
 'id': '8ab9479e-42f4-5d2d-8a4e-8256e191a47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY34106',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 123575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-10',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-28 11:08:53 [auto1.de] INFO: Saving data for SY34106: {'auction_closing_time': 1774716378.0, 'created_time': 1773305456.105949, 'last_price_update_time': 1774696133.469362}
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY34106') HTTP/1.1" 204 0
2026-03-28 11:08:53 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-28 11:08:53 [auto1.de] INFO: Scrape type for JR98479: 2
2026-03-28 11:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479
2026-03-28 11:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbef9642-8ef4-533c-9d0c-89f213793cf7 with scrape type 2
2026-03-28 11:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbef9642-8ef4-533c-9d0c-89f213793cf7 with scrape type 2
2026-03-28 11:08:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbef9642-8ef4-533c-9d0c-89f213793cf7, identifier: JR98479
2026-03-28 11:08:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479
2026-03-28 11:08:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479
2026-03-28 11:08:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbef9642-8ef4-533c-9d0c-89f213793cf7 with identifier: JR98479 to the API
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:36:29Z',
 'fuel_type': 'petrol',
 'id': 'cbef9642-8ef4-533c-9d0c-89f213793cf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR98479',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 91269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-29',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.de] INFO: Saving data for JR98479: {'auction_closing_time': 1774715789.0, 'created_time': 1773382837.87717, 'last_price_update_time': 1774696134.112138}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR98479') HTTP/1.1" 204 0
2026-03-28 11:08:54 [auto1.de] INFO: Found listing with ID: KU06936
2026-03-28 11:08:54 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.de] INFO: Scrape type for KJ86247: 2
2026-03-28 11:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247
2026-03-28 11:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ba46270-addc-54d3-b949-b4eb8697481d with scrape type 2
2026-03-28 11:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ba46270-addc-54d3-b949-b4eb8697481d with scrape type 2
2026-03-28 11:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ba46270-addc-54d3-b949-b4eb8697481d, identifier: KJ86247
2026-03-28 11:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247
2026-03-28 11:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247
2026-03-28 11:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ba46270-addc-54d3-b949-b4eb8697481d with identifier: KJ86247 to the API
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 50,
 'expiration_date': '2026-03-28T16:58:58Z',
 'fuel_type': 'petrol',
 'id': '5ba46270-addc-54d3-b949-b4eb8697481d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ86247',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Lupo',
 'odometer': 87412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-09-30',
 'seller_name': None,
 'title': 'Volkswagen Lupo 1.0 Oxford',
 'transmission': 'manual',
 'trim': 'Oxford',
 'year': 2002}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.de] INFO: Saving data for KJ86247: {'auction_closing_time': 1774717138.0, 'created_time': 1774118969.730182, 'last_price_update_time': 1774696134.592612}
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ86247') HTTP/1.1" 204 0
2026-03-28 11:08:54 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-28 11:08:54 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-28 11:08:54 [auto1.de] INFO: Scrape type for YK98725: 2
2026-03-28 11:08:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725
2026-03-28 11:08:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0b6d57-d74a-52e1-8c56-947ccc99826a with scrape type 2
2026-03-28 11:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a0b6d57-d74a-52e1-8c56-947ccc99826a with scrape type 2
2026-03-28 11:08:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a0b6d57-d74a-52e1-8c56-947ccc99826a, identifier: YK98725
2026-03-28 11:08:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725
2026-03-28 11:08:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725
2026-03-28 11:08:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a0b6d57-d74a-52e1-8c56-947ccc99826a with identifier: YK98725 to the API
2026-03-28 11:08:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:51:21Z',
 'fuel_type': 'petrol',
 'id': '7a0b6d57-d74a-52e1-8c56-947ccc99826a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK98725',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 38839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-31',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-28 11:08:55 [auto1.de] INFO: Saving data for YK98725: {'auction_closing_time': 1774716681.0, 'created_time': 1773401270.60782, 'last_price_update_time': 1774696135.545071}
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK98725') HTTP/1.1" 204 0
2026-03-28 11:08:55 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-28 11:08:55 [auto1.de] INFO: Found listing with ID: NN29334
2026-03-28 11:08:55 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-28 11:08:55 [auto1.de] INFO: Scrape type for DF96715: 2
2026-03-28 11:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715
2026-03-28 11:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with scrape type 2
2026-03-28 11:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with scrape type 2
2026-03-28 11:08:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8, identifier: DF96715
2026-03-28 11:08:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715
2026-03-28 11:08:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715
2026-03-28 11:08:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7742fa76-9cc1-5d9f-b388-0277a7f4e6e8 with identifier: DF96715 to the API
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:44:32Z',
 'fuel_type': 'petrol',
 'id': '7742fa76-9cc1-5d9f-b388-0277a7f4e6e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF96715',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 77424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TSI FR 4Drive',
 'transmission': 'automatic',
 'trim': 'FR 4Drive',
 'year': 2021}
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-28 11:08:55 [auto1.de] INFO: Saving data for DF96715: {'auction_closing_time': 1774716272.0, 'created_time': 1774293551.8757, 'last_price_update_time': 1774696135.957157}
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF96715') HTTP/1.1" 204 0
2026-03-28 11:08:55 [auto1.de] INFO: Channel: 24h | Page: 209 | totalHits: 9706 | hits on page: 40
2026-03-28 11:08:55 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-28 11:08:55 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-28 11:08:55 [auto1.de] INFO: Scrape type for CU86908: 2
2026-03-28 11:08:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908
2026-03-28 11:08:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with scrape type 2
2026-03-28 11:08:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8, identifier: CU86908
2026-03-28 11:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908
2026-03-28 11:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908
2026-03-28 11:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8 with identifier: CU86908 to the API
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:58:01Z',
 'fuel_type': 'diesel',
 'id': 'b7cc38fb-3cd7-54bb-89a8-97bb8e159ad8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU86908',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 219979,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-29',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi Trend Blue',
 'transmission': 'automatic',
 'trim': 'Trend Blue',
 'year': 2016}
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-28 11:08:56 [auto1.de] INFO: Saving data for CU86908: {'auction_closing_time': 1774717081.0, 'created_time': 1773689314.152203, 'last_price_update_time': 1774696136.547512}
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU86908') HTTP/1.1" 204 0
2026-03-28 11:08:56 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-28 11:08:56 [auto1.de] INFO: Scrape type for FN85650: 2
2026-03-28 11:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650
2026-03-28 11:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1c2e178-ce7f-5b09-8064-be885d0c3f8f with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1c2e178-ce7f-5b09-8064-be885d0c3f8f with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1c2e178-ce7f-5b09-8064-be885d0c3f8f, identifier: FN85650
2026-03-28 11:08:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:08:56 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-28 11:08:56 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-28 11:08:56 [auto1.de] INFO: Scrape type for DM70862: 2
2026-03-28 11:08:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862
2026-03-28 11:08:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5fed20-9456-582a-948a-5c9ca0672fbd with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5fed20-9456-582a-948a-5c9ca0672fbd with scrape type 2
2026-03-28 11:08:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5fed20-9456-582a-948a-5c9ca0672fbd, identifier: DM70862
2026-03-28 11:08:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650
2026-03-28 11:08:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650
2026-03-28 11:08:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1c2e178-ce7f-5b09-8064-be885d0c3f8f with identifier: FN85650 to the API
2026-03-28 11:08:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:57:16Z',
 'fuel_type': 'diesel',
 'id': 'c1c2e178-ce7f-5b09-8064-be885d0c3f8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN85650',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 254257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2009}
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-28 11:08:57 [auto1.de] INFO: Saving data for FN85650: {'auction_closing_time': 1774717036.0, 'created_time': 1773303224.078945, 'last_price_update_time': 1774696137.122062}
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN85650') HTTP/1.1" 204 0
2026-03-28 11:08:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862
2026-03-28 11:08:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862
2026-03-28 11:08:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5fed20-9456-582a-948a-5c9ca0672fbd with identifier: DM70862 to the API
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:39:39Z',
 'fuel_type': 'diesel',
 'id': '5d5fed20-9456-582a-948a-5c9ca0672fbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM70862',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 22332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d Mild-Hybrid 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Avantgarde',
 'year': 2023}
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-28 11:08:57 [auto1.de] INFO: Saving data for DM70862: {'auction_closing_time': 1774715979.0, 'created_time': 1773861787.746374, 'last_price_update_time': 1774696137.512279}
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM70862') HTTP/1.1" 204 0
2026-03-28 11:08:57 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-28 11:08:57 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-28 11:08:57 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-28 11:08:57 [auto1.de] INFO: Scrape type for VC80296: 2
2026-03-28 11:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296
2026-03-28 11:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79782f7c-8fc5-5326-b805-52f47039130d with scrape type 2
2026-03-28 11:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79782f7c-8fc5-5326-b805-52f47039130d with scrape type 2
2026-03-28 11:08:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79782f7c-8fc5-5326-b805-52f47039130d, identifier: VC80296
2026-03-28 11:08:57 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-28 11:08:57 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-28 11:08:57 [auto1.de] INFO: Scrape type for RU29030: 2
2026-03-28 11:08:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030
2026-03-28 11:08:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with scrape type 2
2026-03-28 11:08:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with scrape type 2
2026-03-28 11:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa7dd30f-fe61-5917-8a71-83b37c2f8e07, identifier: RU29030
2026-03-28 11:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296
2026-03-28 11:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296
2026-03-28 11:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79782f7c-8fc5-5326-b805-52f47039130d with identifier: VC80296 to the API
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:06:55Z',
 'fuel_type': 'diesel',
 'id': '79782f7c-8fc5-5326-b805-52f47039130d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC80296',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 179501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-04',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2009}
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-28 11:08:58 [auto1.de] INFO: Saving data for VC80296: {'auction_closing_time': 1774714015.0, 'created_time': 1774608091.518063, 'last_price_update_time': 1774696138.297018}
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC80296') HTTP/1.1" 204 0
2026-03-28 11:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030
2026-03-28 11:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030
2026-03-28 11:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa7dd30f-fe61-5917-8a71-83b37c2f8e07 with identifier: RU29030 to the API
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:57:05Z',
 'fuel_type': 'diesel',
 'id': 'fa7dd30f-fe61-5917-8a71-83b37c2f8e07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU29030',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 69046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-24',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Move',
 'transmission': 'automatic',
 'trim': 'Move',
 'year': 2021}
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-28 11:08:58 [auto1.de] INFO: Saving data for RU29030: {'auction_closing_time': 1774717025.0, 'created_time': 1773381073.093071, 'last_price_update_time': 1774696138.641371}
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU29030') HTTP/1.1" 204 0
2026-03-28 11:08:58 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-28 11:08:58 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-28 11:08:58 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-28 11:08:58 [auto1.de] INFO: Scrape type for CR52623: 2
2026-03-28 11:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623
2026-03-28 11:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf909b0-c479-565e-b019-828c74c2efe9 with scrape type 2
2026-03-28 11:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf909b0-c479-565e-b019-828c74c2efe9 with scrape type 2
2026-03-28 11:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf909b0-c479-565e-b019-828c74c2efe9, identifier: CR52623
2026-03-28 11:08:58 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-28 11:08:58 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-28 11:08:58 [auto1.de] INFO: Scrape type for MD24708: 2
2026-03-28 11:08:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708
2026-03-28 11:08:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e52f448-d37d-5714-9374-c06bbaa8e935 with scrape type 2
2026-03-28 11:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e52f448-d37d-5714-9374-c06bbaa8e935 with scrape type 2
2026-03-28 11:08:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e52f448-d37d-5714-9374-c06bbaa8e935, identifier: MD24708
2026-03-28 11:08:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623
2026-03-28 11:08:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623
2026-03-28 11:08:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf909b0-c479-565e-b019-828c74c2efe9 with identifier: CR52623 to the API
2026-03-28 11:08:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:18:06Z',
 'fuel_type': 'diesel',
 'id': 'faf909b0-c479-565e-b019-828c74c2efe9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR52623',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 199818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-13',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 280 K',
 'transmission': 'manual',
 'trim': 'FT 280 K',
 'year': 2009}
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-28 11:08:59 [auto1.de] INFO: Saving data for CR52623: {'auction_closing_time': 1774714686.0, 'created_time': 1773402579.945902, 'last_price_update_time': 1774696139.177524}
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR52623') HTTP/1.1" 204 0
2026-03-28 11:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708
2026-03-28 11:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708
2026-03-28 11:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e52f448-d37d-5714-9374-c06bbaa8e935 with identifier: MD24708 to the API
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:08:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:23:29Z',
 'fuel_type': 'diesel',
 'id': '3e52f448-d37d-5714-9374-c06bbaa8e935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD24708',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 167802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-09',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2014}
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-28 11:08:59 [auto1.de] INFO: Saving data for MD24708: {'auction_closing_time': 1774715009.0, 'created_time': 1773775402.212362, 'last_price_update_time': 1774696139.503317}
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD24708') HTTP/1.1" 204 0
2026-03-28 11:08:59 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-28 11:08:59 [auto1.de] INFO: Scrape type for BK49064: 2
2026-03-28 11:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064
2026-03-28 11:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45a1cb5c-a663-51f5-979a-ec8b11206b9d with scrape type 2
2026-03-28 11:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45a1cb5c-a663-51f5-979a-ec8b11206b9d with scrape type 2
2026-03-28 11:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45a1cb5c-a663-51f5-979a-ec8b11206b9d, identifier: BK49064
2026-03-28 11:08:59 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-28 11:08:59 [auto1.de] INFO: Found listing with ID: YU96411
2026-03-28 11:08:59 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-28 11:08:59 [auto1.de] INFO: Scrape type for YF55621: 2
2026-03-28 11:08:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621
2026-03-28 11:08:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with scrape type 2
2026-03-28 11:08:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with scrape type 2
2026-03-28 11:08:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d21c6585-5bb0-5522-8d5c-8a39cd5aa874, identifier: YF55621
2026-03-28 11:08:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064
2026-03-28 11:08:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064
2026-03-28 11:08:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45a1cb5c-a663-51f5-979a-ec8b11206b9d with identifier: BK49064 to the API
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:08:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:41:40Z',
 'fuel_type': 'petrol',
 'id': '45a1cb5c-a663-51f5-979a-ec8b11206b9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK49064',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 131467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-19',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.4 TSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2013}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-28 11:09:00 [auto1.de] INFO: Saving data for BK49064: {'auction_closing_time': 1774716100.0, 'created_time': 1773307747.900012, 'last_price_update_time': 1774696140.030328}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK49064') HTTP/1.1" 204 0
2026-03-28 11:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621
2026-03-28 11:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621
2026-03-28 11:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d21c6585-5bb0-5522-8d5c-8a39cd5aa874 with identifier: YF55621 to the API
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:13:17Z',
 'fuel_type': 'diesel',
 'id': 'd21c6585-5bb0-5522-8d5c-8a39cd5aa874',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF55621',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 119211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-28 11:09:00 [auto1.de] INFO: Saving data for YF55621: {'auction_closing_time': 1774714397.0, 'created_time': 1774294670.597503, 'last_price_update_time': 1774696140.440326}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF55621') HTTP/1.1" 204 0
2026-03-28 11:09:00 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-28 11:09:00 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-28 11:09:00 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-28 11:09:00 [auto1.de] INFO: Scrape type for WK78247: 2
2026-03-28 11:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247
2026-03-28 11:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58001774-0a17-5d02-93f9-e4958e8e2009 with scrape type 2
2026-03-28 11:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58001774-0a17-5d02-93f9-e4958e8e2009 with scrape type 2
2026-03-28 11:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58001774-0a17-5d02-93f9-e4958e8e2009, identifier: WK78247
2026-03-28 11:09:00 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-28 11:09:00 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-28 11:09:00 [auto1.de] INFO: Scrape type for ZZ43768: 2
2026-03-28 11:09:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768
2026-03-28 11:09:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c2be28d-d61f-58a1-8f16-7034c7136e3d with scrape type 2
2026-03-28 11:09:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c2be28d-d61f-58a1-8f16-7034c7136e3d with scrape type 2
2026-03-28 11:09:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c2be28d-d61f-58a1-8f16-7034c7136e3d, identifier: ZZ43768
2026-03-28 11:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247
2026-03-28 11:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247
2026-03-28 11:09:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58001774-0a17-5d02-93f9-e4958e8e2009 with identifier: WK78247 to the API
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:41:30Z',
 'fuel_type': 'petrol',
 'id': '58001774-0a17-5d02-93f9-e4958e8e2009',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK78247',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 145009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-30',
 'seller_name': None,
 'title': 'Porsche Panamera 3.6',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-28 11:09:00 [auto1.de] INFO: Saving data for WK78247: {'auction_closing_time': 1774716090.0, 'created_time': 1773775912.694358, 'last_price_update_time': 1774696140.978932}
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK78247') HTTP/1.1" 204 0
2026-03-28 11:09:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768
2026-03-28 11:09:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768
2026-03-28 11:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c2be28d-d61f-58a1-8f16-7034c7136e3d with identifier: ZZ43768 to the API
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:39:16Z',
 'fuel_type': 'diesel',
 'id': '1c2be28d-d61f-58a1-8f16-7034c7136e3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ43768',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 245269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-30',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2014}
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.de] INFO: Saving data for ZZ43768: {'auction_closing_time': 1774715956.0, 'created_time': 1773342872.518771, 'last_price_update_time': 1774696141.35368}
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ43768') HTTP/1.1" 204 0
2026-03-28 11:09:01 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-28 11:09:01 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.de] INFO: Scrape type for ZC13254: 2
2026-03-28 11:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254
2026-03-28 11:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5bff240-ac6e-58e7-811d-b4244204b4ea with scrape type 2
2026-03-28 11:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5bff240-ac6e-58e7-811d-b4244204b4ea with scrape type 2
2026-03-28 11:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5bff240-ac6e-58e7-811d-b4244204b4ea, identifier: ZC13254
2026-03-28 11:09:01 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.de] INFO: Scrape type for SB04104: 2
2026-03-28 11:09:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104
2026-03-28 11:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 810e3f38-3373-571a-ae95-ca7dda2783d0 with scrape type 2
2026-03-28 11:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 810e3f38-3373-571a-ae95-ca7dda2783d0 with scrape type 2
2026-03-28 11:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 810e3f38-3373-571a-ae95-ca7dda2783d0, identifier: SB04104
2026-03-28 11:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254
2026-03-28 11:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254
2026-03-28 11:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5bff240-ac6e-58e7-811d-b4244204b4ea with identifier: ZC13254 to the API
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:57:17Z',
 'fuel_type': 'diesel',
 'id': 'b5bff240-ac6e-58e7-811d-b4244204b4ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC13254',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 255829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2016}
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-28 11:09:01 [auto1.de] INFO: Saving data for ZC13254: {'auction_closing_time': 1774717037.0, 'created_time': 1773307849.083539, 'last_price_update_time': 1774696141.963693}
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC13254') HTTP/1.1" 204 0
2026-03-28 11:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104
2026-03-28 11:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104
2026-03-28 11:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 810e3f38-3373-571a-ae95-ca7dda2783d0 with identifier: SB04104 to the API
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:37:08Z',
 'fuel_type': 'diesel',
 'id': '810e3f38-3373-571a-ae95-ca7dda2783d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB04104',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 219697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [auto1.de] INFO: Saving data for SB04104: {'auction_closing_time': 1774715828.0, 'created_time': 1773307850.246341, 'last_price_update_time': 1774696142.36172}
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB04104') HTTP/1.1" 204 0
2026-03-28 11:09:02 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [auto1.de] INFO: Scrape type for TE33138: 2
2026-03-28 11:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138
2026-03-28 11:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 013dee42-5b46-5376-9494-28a7b737d5d1 with scrape type 2
2026-03-28 11:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 013dee42-5b46-5376-9494-28a7b737d5d1 with scrape type 2
2026-03-28 11:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 013dee42-5b46-5376-9494-28a7b737d5d1, identifier: TE33138
2026-03-28 11:09:02 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-28 11:09:02 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [auto1.de] INFO: Scrape type for MJ60689: 2
2026-03-28 11:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689
2026-03-28 11:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2118a9bc-558a-520a-a7f0-d34c6377ae8c with scrape type 2
2026-03-28 11:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2118a9bc-558a-520a-a7f0-d34c6377ae8c with scrape type 2
2026-03-28 11:09:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2118a9bc-558a-520a-a7f0-d34c6377ae8c, identifier: MJ60689
2026-03-28 11:09:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138
2026-03-28 11:09:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138
2026-03-28 11:09:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 013dee42-5b46-5376-9494-28a7b737d5d1 with identifier: TE33138 to the API
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:01:49Z',
 'fuel_type': 'petrol',
 'id': '013dee42-5b46-5376-9494-28a7b737d5d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE33138',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'RCZ',
 'odometer': 116417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'Peugeot RCZ 1.6 THP Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2012}
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [auto1.de] INFO: Saving data for TE33138: {'auction_closing_time': 1774713709.0, 'created_time': 1774264872.736288, 'last_price_update_time': 1774696142.981984}
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE33138') HTTP/1.1" 204 0
2026-03-28 11:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689
2026-03-28 11:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689
2026-03-28 11:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2118a9bc-558a-520a-a7f0-d34c6377ae8c with identifier: MJ60689 to the API
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:50:13Z',
 'fuel_type': 'diesel',
 'id': '2118a9bc-558a-520a-a7f0-d34c6377ae8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ60689',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 214351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-09',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [auto1.de] INFO: Saving data for MJ60689: {'auction_closing_time': 1774716613.0, 'created_time': 1773830340.42552, 'last_price_update_time': 1774696143.388877}
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ60689') HTTP/1.1" 204 0
2026-03-28 11:09:03 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB58638%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [auto1.de] INFO: Scrape type for FB58638: 0
2026-03-28 11:09:03 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [auto1.de] INFO: Scrape type for SA94096: 2
2026-03-28 11:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096
2026-03-28 11:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a256c9-b188-5fcc-843a-e6b4896b9835 with scrape type 2
2026-03-28 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a256c9-b188-5fcc-843a-e6b4896b9835 with scrape type 2
2026-03-28 11:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4a256c9-b188-5fcc-843a-e6b4896b9835, identifier: SA94096
2026-03-28 11:09:03 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [auto1.de] INFO: Scrape type for RJ71204: 2
2026-03-28 11:09:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204
2026-03-28 11:09:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e95a1df0-e40c-50bd-9721-20cf7e298200 with scrape type 2
2026-03-28 11:09:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e95a1df0-e40c-50bd-9721-20cf7e298200 with scrape type 2
2026-03-28 11:09:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e95a1df0-e40c-50bd-9721-20cf7e298200, identifier: RJ71204
2026-03-28 11:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096
2026-03-28 11:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096
2026-03-28 11:09:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4a256c9-b188-5fcc-843a-e6b4896b9835 with identifier: SA94096 to the API
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:41:41Z',
 'fuel_type': 'petrol',
 'id': 'a4a256c9-b188-5fcc-843a-e6b4896b9835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA94096',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 40963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-31',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2023}
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [auto1.de] INFO: Saving data for SA94096: {'auction_closing_time': 1774716101.0, 'created_time': 1773307114.572102, 'last_price_update_time': 1774696143.980265}
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA94096') HTTP/1.1" 204 0
2026-03-28 11:09:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204
2026-03-28 11:09:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204
2026-03-28 11:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e95a1df0-e40c-50bd-9721-20cf7e298200 with identifier: RJ71204 to the API
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:33:00Z',
 'fuel_type': 'diesel',
 'id': 'e95a1df0-e40c-50bd-9721-20cf7e298200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ71204',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 130501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-20',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2019}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.de] INFO: Saving data for RJ71204: {'auction_closing_time': 1774715580.0, 'created_time': 1774291517.558018, 'last_price_update_time': 1774696144.30018}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ71204') HTTP/1.1" 204 0
2026-03-28 11:09:04 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-28 11:09:04 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.de] INFO: Scrape type for ND38532: 2
2026-03-28 11:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532
2026-03-28 11:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58bfe349-cf26-5853-9df2-e562fedd2daf with scrape type 2
2026-03-28 11:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58bfe349-cf26-5853-9df2-e562fedd2daf with scrape type 2
2026-03-28 11:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58bfe349-cf26-5853-9df2-e562fedd2daf, identifier: ND38532
2026-03-28 11:09:04 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-28 11:09:04 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.de] INFO: Scrape type for UF88550: 2
2026-03-28 11:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550
2026-03-28 11:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afc428fd-cfba-5e75-b43c-c0704bde8799 with scrape type 2
2026-03-28 11:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afc428fd-cfba-5e75-b43c-c0704bde8799 with scrape type 2
2026-03-28 11:09:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afc428fd-cfba-5e75-b43c-c0704bde8799, identifier: UF88550
2026-03-28 11:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532
2026-03-28 11:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532
2026-03-28 11:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58bfe349-cf26-5853-9df2-e562fedd2daf with identifier: ND38532 to the API
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-28T16:55:23Z',
 'fuel_type': 'petrol',
 'id': '58bfe349-cf26-5853-9df2-e562fedd2daf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND38532',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 85127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [auto1.de] INFO: Saving data for ND38532: {'auction_closing_time': 1774716923.0, 'created_time': 1773307455.171278, 'last_price_update_time': 1774696144.847069}
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND38532') HTTP/1.1" 204 0
2026-03-28 11:09:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550
2026-03-28 11:09:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550
2026-03-28 11:09:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afc428fd-cfba-5e75-b43c-c0704bde8799 with identifier: UF88550 to the API
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:40:15Z',
 'fuel_type': 'diesel',
 'id': 'afc428fd-cfba-5e75-b43c-c0704bde8799',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF88550',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 267188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-28 11:09:05 [auto1.de] INFO: Saving data for UF88550: {'auction_closing_time': 1774716015.0, 'created_time': 1773830357.863718, 'last_price_update_time': 1774696145.157354}
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF88550') HTTP/1.1" 204 0
2026-03-28 11:09:05 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-28 11:09:05 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-28 11:09:05 [auto1.de] INFO: Scrape type for BK53036: 2
2026-03-28 11:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036
2026-03-28 11:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12eeedbd-107e-5689-b2b4-ee044ea48bfa with scrape type 2
2026-03-28 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12eeedbd-107e-5689-b2b4-ee044ea48bfa with scrape type 2
2026-03-28 11:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12eeedbd-107e-5689-b2b4-ee044ea48bfa, identifier: BK53036
2026-03-28 11:09:05 [auto1.de] INFO: Found listing with ID: RU03073
2026-03-28 11:09:05 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-28 11:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036
2026-03-28 11:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036
2026-03-28 11:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12eeedbd-107e-5689-b2b4-ee044ea48bfa with identifier: BK53036 to the API
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:52:44Z',
 'fuel_type': 'diesel',
 'id': '12eeedbd-107e-5689-b2b4-ee044ea48bfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK53036',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 158403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2012}
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-28 11:09:05 [auto1.de] INFO: Saving data for BK53036: {'auction_closing_time': 1774716764.0, 'created_time': 1774294786.521126, 'last_price_update_time': 1774696145.605022}
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK53036') HTTP/1.1" 204 0
2026-03-28 11:09:05 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-28 11:09:05 [auto1.de] INFO: Scrape type for PU73268: 2
2026-03-28 11:09:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268
2026-03-28 11:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07c0d91a-4bd2-5b0f-9144-89bf7972298f with scrape type 2
2026-03-28 11:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07c0d91a-4bd2-5b0f-9144-89bf7972298f with scrape type 2
2026-03-28 11:09:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07c0d91a-4bd2-5b0f-9144-89bf7972298f, identifier: PU73268
2026-03-28 11:09:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268
2026-03-28 11:09:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268
2026-03-28 11:09:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07c0d91a-4bd2-5b0f-9144-89bf7972298f with identifier: PU73268 to the API
2026-03-28 11:09:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:27:18Z',
 'fuel_type': 'petrol',
 'id': '07c0d91a-4bd2-5b0f-9144-89bf7972298f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU73268',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 122365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-13',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.de] INFO: Saving data for PU73268: {'auction_closing_time': 1774715238.0, 'created_time': 1772541052.119915, 'last_price_update_time': 1774696146.156981}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU73268') HTTP/1.1" 204 0
2026-03-28 11:09:06 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.de] INFO: Scrape type for GX10720: 2
2026-03-28 11:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720
2026-03-28 11:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72ac3892-ede8-5be1-853a-840a83d82e17 with scrape type 2
2026-03-28 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72ac3892-ede8-5be1-853a-840a83d82e17 with scrape type 2
2026-03-28 11:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72ac3892-ede8-5be1-853a-840a83d82e17, identifier: GX10720
2026-03-28 11:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720
2026-03-28 11:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720
2026-03-28 11:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72ac3892-ede8-5be1-853a-840a83d82e17 with identifier: GX10720 to the API
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:03:07Z',
 'fuel_type': 'petrol',
 'id': '72ac3892-ede8-5be1-853a-840a83d82e17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX10720',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 124543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-13',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2014}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.de] INFO: Saving data for GX10720: {'auction_closing_time': 1774713787.0, 'created_time': 1773301478.649371, 'last_price_update_time': 1774696146.569092}
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX10720') HTTP/1.1" 204 0
2026-03-28 11:09:06 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-28 11:09:06 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-28 11:09:06 [auto1.de] INFO: Found listing with ID: DT83749
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT83749%27 HTTP/1.1" 200 None
2026-03-28 11:09:06 [auto1.de] INFO: Scrape type for DT83749: 2
2026-03-28 11:09:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d13efd5-a8d4-554f-9258-a54da15b0800 with identifier: DT83749
2026-03-28 11:09:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d13efd5-a8d4-554f-9258-a54da15b0800 with scrape type 2
2026-03-28 11:09:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d13efd5-a8d4-554f-9258-a54da15b0800 with scrape type 2
2026-03-28 11:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d13efd5-a8d4-554f-9258-a54da15b0800, identifier: DT83749
2026-03-28 11:09:06 [scrapy.extensions.logstats] INFO: Crawled 425 pages (at 6 pages/min), scraped 490 items (at 107 items/min)
2026-03-28 11:09:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d13efd5-a8d4-554f-9258-a54da15b0800 with identifier: DT83749
2026-03-28 11:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d13efd5-a8d4-554f-9258-a54da15b0800 with identifier: DT83749
2026-03-28 11:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d13efd5-a8d4-554f-9258-a54da15b0800 with identifier: DT83749 to the API
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:29:37Z',
 'fuel_type': 'diesel',
 'id': '9d13efd5-a8d4-554f-9258-a54da15b0800',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT83749',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 300627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC',
 'transmission': 'automatic',
 'trim': 'T BlueTEC',
 'year': 2015}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT83749%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.de] INFO: Saving data for DT83749: {'auction_closing_time': 1774715377.0, 'created_time': 1773303574.476472, 'last_price_update_time': 1774696147.025261}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT83749') HTTP/1.1" 204 0
2026-03-28 11:09:07 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.de] INFO: Scrape type for UH00039: 2
2026-03-28 11:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039
2026-03-28 11:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with scrape type 2
2026-03-28 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with scrape type 2
2026-03-28 11:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e, identifier: UH00039
2026-03-28 11:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039
2026-03-28 11:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039
2026-03-28 11:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e with identifier: UH00039 to the API
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:54:30Z',
 'fuel_type': 'petrol',
 'id': '66370de4-3cd5-5f0b-bc61-e0ab0bfddb0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH00039',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo',
 'odometer': 139195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Ford Tourneo 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.de] INFO: Saving data for UH00039: {'auction_closing_time': 1774716870.0, 'created_time': 1773858927.548276, 'last_price_update_time': 1774696147.422283}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH00039') HTTP/1.1" 204 0
2026-03-28 11:09:07 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.de] INFO: Scrape type for SA71883: 2
2026-03-28 11:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883
2026-03-28 11:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with scrape type 2
2026-03-28 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with scrape type 2
2026-03-28 11:09:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b, identifier: SA71883
2026-03-28 11:09:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883
2026-03-28 11:09:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883
2026-03-28 11:09:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b with identifier: SA71883 to the API
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:18:40Z',
 'fuel_type': 'petrol',
 'id': '3877be4a-6362-5d5b-b4e8-f2bdee9d9c4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA71883',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 123196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-28',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2016}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.de] INFO: Saving data for SA71883: {'auction_closing_time': 1774714720.0, 'created_time': 1773307123.653284, 'last_price_update_time': 1774696147.869611}
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA71883') HTTP/1.1" 204 0
2026-03-28 11:09:07 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-28 11:09:07 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-28 11:09:07 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-28 11:09:07 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-28 11:09:07 [auto1.de] INFO: Scrape type for YP68247: 2
2026-03-28 11:09:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247
2026-03-28 11:09:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9b49b6-c686-54c5-aa17-30e83c44ca5c with scrape type 2
2026-03-28 11:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd9b49b6-c686-54c5-aa17-30e83c44ca5c with scrape type 2
2026-03-28 11:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd9b49b6-c686-54c5-aa17-30e83c44ca5c, identifier: YP68247
2026-03-28 11:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247
2026-03-28 11:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247
2026-03-28 11:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd9b49b6-c686-54c5-aa17-30e83c44ca5c with identifier: YP68247 to the API
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:03Z',
 'fuel_type': 'petrol',
 'id': 'dd9b49b6-c686-54c5-aa17-30e83c44ca5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP68247',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 16621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 180 Mild-Hybrid Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2023}
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-28 11:09:08 [auto1.de] INFO: Saving data for YP68247: {'auction_closing_time': 1774714803.0, 'created_time': 1773401754.925079, 'last_price_update_time': 1774696148.333666}
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP68247') HTTP/1.1" 204 0
2026-03-28 11:09:08 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-28 11:09:08 [auto1.de] INFO: Scrape type for HY47852: 2
2026-03-28 11:09:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852
2026-03-28 11:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with scrape type 2
2026-03-28 11:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with scrape type 2
2026-03-28 11:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665, identifier: HY47852
2026-03-28 11:09:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852
2026-03-28 11:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852
2026-03-28 11:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ac0ffb0-805d-5c0a-b3f7-98d42792c665 with identifier: HY47852 to the API
2026-03-28 11:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:46:25Z',
 'fuel_type': 'diesel',
 'id': '6ac0ffb0-805d-5c0a-b3f7-98d42792c665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY47852',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 193655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-20',
 'seller_name': None,
 'title': 'BMW X1 xDrive 25d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-28 11:09:09 [auto1.de] INFO: Saving data for HY47852: {'auction_closing_time': 1774716385.0, 'created_time': 1773134432.947238, 'last_price_update_time': 1774696149.587113}
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY47852') HTTP/1.1" 204 0
2026-03-28 11:09:09 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-28 11:09:09 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-28 11:09:09 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-28 11:09:09 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-28 11:09:09 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-28 11:09:09 [auto1.de] INFO: Scrape type for AP27918: 2
2026-03-28 11:09:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918
2026-03-28 11:09:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d8ed02-68c0-584c-a6b9-9da3709cc07e with scrape type 2
2026-03-28 11:09:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93d8ed02-68c0-584c-a6b9-9da3709cc07e with scrape type 2
2026-03-28 11:09:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93d8ed02-68c0-584c-a6b9-9da3709cc07e, identifier: AP27918
2026-03-28 11:09:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918
2026-03-28 11:09:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918
2026-03-28 11:09:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93d8ed02-68c0-584c-a6b9-9da3709cc07e with identifier: AP27918 to the API
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:48:33Z',
 'fuel_type': 'petrol',
 'id': '93d8ed02-68c0-584c-a6b9-9da3709cc07e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP27918',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 134961,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-28 11:09:09 [auto1.de] INFO: Saving data for AP27918: {'auction_closing_time': 1774716513.0, 'created_time': 1773342116.085903, 'last_price_update_time': 1774696149.990542}
2026-03-28 11:09:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP27918') HTTP/1.1" 204 0
2026-03-28 11:09:10 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-28 11:09:10 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-28 11:09:10 [auto1.de] INFO: Scrape type for UD88757: 2
2026-03-28 11:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757
2026-03-28 11:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 958bc99d-032a-5912-b8cb-b363884515d8 with scrape type 2
2026-03-28 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 958bc99d-032a-5912-b8cb-b363884515d8 with scrape type 2
2026-03-28 11:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 958bc99d-032a-5912-b8cb-b363884515d8, identifier: UD88757
2026-03-28 11:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757
2026-03-28 11:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757
2026-03-28 11:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 958bc99d-032a-5912-b8cb-b363884515d8 with identifier: UD88757 to the API
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:44:55Z',
 'fuel_type': 'petrol',
 'id': '958bc99d-032a-5912-b8cb-b363884515d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD88757',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 156121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-29',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Passion',
 'transmission': 'manual',
 'trim': 'Passion',
 'year': 2018}
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-28 11:09:10 [auto1.de] INFO: Saving data for UD88757: {'auction_closing_time': 1774716295.0, 'created_time': 1773774349.746941, 'last_price_update_time': 1774696150.765918}
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD88757') HTTP/1.1" 204 0
2026-03-28 11:09:10 [auto1.de] INFO: Channel: 24h | Page: 210 | totalHits: 9706 | hits on page: 40
2026-03-28 11:09:10 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-28 11:09:10 [auto1.de] INFO: Scrape type for JC63536: 2
2026-03-28 11:09:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536
2026-03-28 11:09:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with scrape type 2
2026-03-28 11:09:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with scrape type 2
2026-03-28 11:09:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d, identifier: JC63536
2026-03-28 11:09:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536
2026-03-28 11:09:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536
2026-03-28 11:09:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c7f6d67-bd1a-5d06-9127-4fe4e76a209d with identifier: JC63536 to the API
2026-03-28 11:09:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:28:57Z',
 'fuel_type': 'petrol',
 'id': '0c7f6d67-bd1a-5d06-9127-4fe4e76a209d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC63536',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 205020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-15',
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.de] INFO: Saving data for JC63536: {'auction_closing_time': 1774715337.0, 'created_time': 1773571978.063143, 'last_price_update_time': 1774696151.184278}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC63536') HTTP/1.1" 204 0
2026-03-28 11:09:11 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-28 11:09:11 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-28 11:09:11 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.de] INFO: Scrape type for CR82363: 2
2026-03-28 11:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363
2026-03-28 11:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8115376a-7023-509e-b254-34d98d67b8b8 with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8115376a-7023-509e-b254-34d98d67b8b8 with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8115376a-7023-509e-b254-34d98d67b8b8, identifier: CR82363
2026-03-28 11:09:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363
2026-03-28 11:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363
2026-03-28 11:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8115376a-7023-509e-b254-34d98d67b8b8 with identifier: CR82363 to the API
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:08:06Z',
 'fuel_type': 'petrol',
 'id': '8115376a-7023-509e-b254-34d98d67b8b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR82363',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 142574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-19',
 'seller_name': None,
 'title': 'BMW 1er 120i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.de] INFO: Saving data for CR82363: {'auction_closing_time': 1774714086.0, 'created_time': 1772728201.318158, 'last_price_update_time': 1774696151.626995}
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR82363') HTTP/1.1" 204 0
2026-03-28 11:09:11 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-28 11:09:11 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-28 11:09:11 [auto1.de] INFO: Scrape type for KE42269: 2
2026-03-28 11:09:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269
2026-03-28 11:09:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09fc1083-9f78-53bc-a60f-12850c60d0cc with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09fc1083-9f78-53bc-a60f-12850c60d0cc with scrape type 2
2026-03-28 11:09:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09fc1083-9f78-53bc-a60f-12850c60d0cc, identifier: KE42269
2026-03-28 11:09:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269
2026-03-28 11:09:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269
2026-03-28 11:09:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09fc1083-9f78-53bc-a60f-12850c60d0cc with identifier: KE42269 to the API
2026-03-28 11:09:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:32:33Z',
 'fuel_type': 'diesel',
 'id': '09fc1083-9f78-53bc-a60f-12850c60d0cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE42269',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 111953,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2017}
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-28 11:09:12 [auto1.de] INFO: Saving data for KE42269: {'auction_closing_time': 1774715553.0, 'created_time': 1774291383.186723, 'last_price_update_time': 1774696152.167522}
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE42269') HTTP/1.1" 204 0
2026-03-28 11:09:12 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-28 11:09:12 [auto1.de] INFO: Scrape type for BA02242: 2
2026-03-28 11:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242
2026-03-28 11:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 988c78ac-9879-586e-a5ff-3af448bc5097 with scrape type 2
2026-03-28 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 988c78ac-9879-586e-a5ff-3af448bc5097 with scrape type 2
2026-03-28 11:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 988c78ac-9879-586e-a5ff-3af448bc5097, identifier: BA02242
2026-03-28 11:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242
2026-03-28 11:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242
2026-03-28 11:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 988c78ac-9879-586e-a5ff-3af448bc5097 with identifier: BA02242 to the API
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:16:50Z',
 'fuel_type': 'petrol',
 'id': '988c78ac-9879-586e-a5ff-3af448bc5097',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA02242',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 184407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-28 11:09:12 [auto1.de] INFO: Saving data for BA02242: {'auction_closing_time': 1774714610.0, 'created_time': 1773861701.373535, 'last_price_update_time': 1774696152.59692}
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA02242') HTTP/1.1" 204 0
2026-03-28 11:09:12 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-28 11:09:12 [auto1.de] INFO: Scrape type for AW26352: 2
2026-03-28 11:09:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352
2026-03-28 11:09:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with scrape type 2
2026-03-28 11:09:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with scrape type 2
2026-03-28 11:09:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c, identifier: AW26352
2026-03-28 11:09:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352
2026-03-28 11:09:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352
2026-03-28 11:09:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8697a5a0-d1b7-5856-bfbb-ad5b7515585c with identifier: AW26352 to the API
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:27Z',
 'fuel_type': 'petrol',
 'id': '8697a5a0-d1b7-5856-bfbb-ad5b7515585c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW26352',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 99689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-12',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2020}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.de] INFO: Saving data for AW26352: {'auction_closing_time': 1774716987.0, 'created_time': 1773686944.960894, 'last_price_update_time': 1774696153.022717}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW26352') HTTP/1.1" 204 0
2026-03-28 11:09:13 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.de] INFO: Scrape type for ZP61360: 2
2026-03-28 11:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360
2026-03-28 11:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5429fbce-c6cf-594a-849c-75a0c5adb0b7, identifier: ZP61360
2026-03-28 11:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360
2026-03-28 11:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360
2026-03-28 11:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5429fbce-c6cf-594a-849c-75a0c5adb0b7 with identifier: ZP61360 to the API
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:45:41Z',
 'fuel_type': 'petrol',
 'id': '5429fbce-c6cf-594a-849c-75a0c5adb0b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP61360',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 142946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2009}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.de] INFO: Saving data for ZP61360: {'auction_closing_time': 1774716341.0, 'created_time': 1774251393.89176, 'last_price_update_time': 1774696153.466458}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP61360') HTTP/1.1" 204 0
2026-03-28 11:09:13 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-28 11:09:13 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-28 11:09:13 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.de] INFO: Scrape type for YM40569: 2
2026-03-28 11:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569
2026-03-28 11:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87913c5e-f7ee-5805-8e0d-3222a563c492 with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87913c5e-f7ee-5805-8e0d-3222a563c492 with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87913c5e-f7ee-5805-8e0d-3222a563c492, identifier: YM40569
2026-03-28 11:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569
2026-03-28 11:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569
2026-03-28 11:09:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87913c5e-f7ee-5805-8e0d-3222a563c492 with identifier: YM40569 to the API
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:56:51Z',
 'fuel_type': 'petrol',
 'id': '87913c5e-f7ee-5805-8e0d-3222a563c492',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM40569',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 143743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-12',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2012}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.de] INFO: Saving data for YM40569: {'auction_closing_time': 1774717011.0, 'created_time': 1774264127.95052, 'last_price_update_time': 1774696153.86581}
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM40569') HTTP/1.1" 204 0
2026-03-28 11:09:13 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-28 11:09:13 [auto1.de] INFO: Scrape type for AE71125: 2
2026-03-28 11:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125
2026-03-28 11:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b489831-986d-54d2-a55c-242345021697 with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b489831-986d-54d2-a55c-242345021697 with scrape type 2
2026-03-28 11:09:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b489831-986d-54d2-a55c-242345021697, identifier: AE71125
2026-03-28 11:09:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125
2026-03-28 11:09:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125
2026-03-28 11:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b489831-986d-54d2-a55c-242345021697 with identifier: AE71125 to the API
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:21:00Z',
 'fuel_type': 'diesel',
 'id': '2b489831-986d-54d2-a55c-242345021697',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE71125',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 248477,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Edition Classic',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Edition Classic',
 'year': 2014}
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-28 11:09:14 [auto1.de] INFO: Saving data for AE71125: {'auction_closing_time': 1774714860.0, 'created_time': 1774293902.057252, 'last_price_update_time': 1774696154.286439}
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE71125') HTTP/1.1" 204 0
2026-03-28 11:09:14 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-28 11:09:14 [auto1.de] INFO: Found listing with ID: TF25150
2026-03-28 11:09:14 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-28 11:09:14 [auto1.de] INFO: Scrape type for TL23560: 2
2026-03-28 11:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560
2026-03-28 11:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b71fb49-9367-5d14-a749-7b3a6867db91 with scrape type 2
2026-03-28 11:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b71fb49-9367-5d14-a749-7b3a6867db91 with scrape type 2
2026-03-28 11:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b71fb49-9367-5d14-a749-7b3a6867db91, identifier: TL23560
2026-03-28 11:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560
2026-03-28 11:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560
2026-03-28 11:09:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b71fb49-9367-5d14-a749-7b3a6867db91 with identifier: TL23560 to the API
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:39Z',
 'fuel_type': 'petrol',
 'id': '1b71fb49-9367-5d14-a749-7b3a6867db91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL23560',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Sedici',
 'odometer': 103933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-29',
 'seller_name': None,
 'title': 'Fiat Sedici 1.6 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2010}
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-28 11:09:14 [auto1.de] INFO: Saving data for TL23560: {'auction_closing_time': 1774716759.0, 'created_time': 1774294390.48762, 'last_price_update_time': 1774696154.685874}
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL23560') HTTP/1.1" 204 0
2026-03-28 11:09:14 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-28 11:09:14 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-28 11:09:14 [auto1.de] INFO: Scrape type for DG19497: 2
2026-03-28 11:09:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497
2026-03-28 11:09:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c60f48c-22d3-5757-b4e3-533f77f027f0 with scrape type 2
2026-03-28 11:09:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c60f48c-22d3-5757-b4e3-533f77f027f0 with scrape type 2
2026-03-28 11:09:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c60f48c-22d3-5757-b4e3-533f77f027f0, identifier: DG19497
2026-03-28 11:09:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497
2026-03-28 11:09:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497
2026-03-28 11:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c60f48c-22d3-5757-b4e3-533f77f027f0 with identifier: DG19497 to the API
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:20:52Z',
 'fuel_type': 'diesel',
 'id': '9c60f48c-22d3-5757-b4e3-533f77f027f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG19497',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 64528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-31',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.de] INFO: Saving data for DG19497: {'auction_closing_time': 1774714852.0, 'created_time': 1773306129.995433, 'last_price_update_time': 1774696155.211761}
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG19497') HTTP/1.1" 204 0
2026-03-28 11:09:15 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-28 11:09:15 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-28 11:09:15 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-28 11:09:15 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.de] INFO: Scrape type for UX48590: 2
2026-03-28 11:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590
2026-03-28 11:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da8a9319-d6d8-5622-bed5-4f22327961fe with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da8a9319-d6d8-5622-bed5-4f22327961fe with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da8a9319-d6d8-5622-bed5-4f22327961fe, identifier: UX48590
2026-03-28 11:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590
2026-03-28 11:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590
2026-03-28 11:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da8a9319-d6d8-5622-bed5-4f22327961fe with identifier: UX48590 to the API
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:25:55Z',
 'fuel_type': 'petrol',
 'id': 'da8a9319-d6d8-5622-bed5-4f22327961fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX48590',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 141876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-09',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2015}
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.de] INFO: Saving data for UX48590: {'auction_closing_time': 1774715155.0, 'created_time': 1773859300.489328, 'last_price_update_time': 1774696155.629718}
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX48590') HTTP/1.1" 204 0
2026-03-28 11:09:15 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-28 11:09:15 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-28 11:09:15 [auto1.de] INFO: Scrape type for UJ12211: 2
2026-03-28 11:09:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211
2026-03-28 11:09:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4166ded8-a037-5444-9372-94f93340ebbe with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4166ded8-a037-5444-9372-94f93340ebbe with scrape type 2
2026-03-28 11:09:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4166ded8-a037-5444-9372-94f93340ebbe, identifier: UJ12211
2026-03-28 11:09:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211
2026-03-28 11:09:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211
2026-03-28 11:09:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4166ded8-a037-5444-9372-94f93340ebbe with identifier: UJ12211 to the API
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:50:08Z',
 'fuel_type': 'petrol',
 'id': '4166ded8-a037-5444-9372-94f93340ebbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ12211',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 149391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-18',
 'seller_name': None,
 'title': 'Renault Megane 2.0 BOSE Edition',
 'transmission': 'automatic',
 'trim': 'BOSE Edition',
 'year': 2013}
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.de] INFO: Saving data for UJ12211: {'auction_closing_time': 1774716608.0, 'created_time': 1774265321.633389, 'last_price_update_time': 1774696156.089442}
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ12211') HTTP/1.1" 204 0
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.de] INFO: Scrape type for GT07597: 2
2026-03-28 11:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597
2026-03-28 11:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94618181-a007-5681-a993-99cd06fd6684 with scrape type 2
2026-03-28 11:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94618181-a007-5681-a993-99cd06fd6684 with scrape type 2
2026-03-28 11:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94618181-a007-5681-a993-99cd06fd6684, identifier: GT07597
2026-03-28 11:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597
2026-03-28 11:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597
2026-03-28 11:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94618181-a007-5681-a993-99cd06fd6684 with identifier: GT07597 to the API
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:53:16Z',
 'fuel_type': 'diesel',
 'id': '94618181-a007-5681-a993-99cd06fd6684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT07597',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 272188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'BMW 5er 525d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.de] INFO: Saving data for GT07597: {'auction_closing_time': 1774716796.0, 'created_time': 1773306241.494342, 'last_price_update_time': 1774696156.535306}
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT07597') HTTP/1.1" 204 0
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-28 11:09:16 [auto1.de] INFO: Found listing with ID: US02416
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [auto1.de] INFO: Scrape type for US02416: 2
2026-03-28 11:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416
2026-03-28 11:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a63059-8058-5728-b6e8-d885d00603d7 with scrape type 2
2026-03-28 11:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a63059-8058-5728-b6e8-d885d00603d7 with scrape type 2
2026-03-28 11:09:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28a63059-8058-5728-b6e8-d885d00603d7, identifier: US02416
2026-03-28 11:09:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416
2026-03-28 11:09:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416
2026-03-28 11:09:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28a63059-8058-5728-b6e8-d885d00603d7 with identifier: US02416 to the API
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:15:44Z',
 'fuel_type': 'petrol',
 'id': '28a63059-8058-5728-b6e8-d885d00603d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US02416',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 148453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-30',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2008}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.de] INFO: Saving data for US02416: {'auction_closing_time': 1774714544.0, 'created_time': 1773307836.987222, 'last_price_update_time': 1774696157.081089}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US02416') HTTP/1.1" 204 0
2026-03-28 11:09:17 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-28 11:09:17 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-28 11:09:17 [auto1.de] INFO: Found listing with ID: CV35791
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV35791%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.de] INFO: Scrape type for CV35791: 2
2026-03-28 11:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d19f4928-f2b1-5682-97e3-2b0388039e04 with identifier: CV35791
2026-03-28 11:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19f4928-f2b1-5682-97e3-2b0388039e04 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d19f4928-f2b1-5682-97e3-2b0388039e04 with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d19f4928-f2b1-5682-97e3-2b0388039e04, identifier: CV35791
2026-03-28 11:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d19f4928-f2b1-5682-97e3-2b0388039e04 with identifier: CV35791
2026-03-28 11:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d19f4928-f2b1-5682-97e3-2b0388039e04 with identifier: CV35791
2026-03-28 11:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d19f4928-f2b1-5682-97e3-2b0388039e04 with identifier: CV35791 to the API
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:23:36Z',
 'fuel_type': 'petrol',
 'id': 'd19f4928-f2b1-5682-97e3-2b0388039e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV35791',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 127010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-01',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2014}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV35791%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.de] INFO: Saving data for CV35791: {'auction_closing_time': 1774715016.0, 'created_time': 1774608087.324686, 'last_price_update_time': 1774696157.74203}
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV35791') HTTP/1.1" 204 0
2026-03-28 11:09:17 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [auto1.de] INFO: Scrape type for BF26414: 2
2026-03-28 11:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414
2026-03-28 11:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e32be1cd-98d0-5a68-bb91-97a0376e72fe with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e32be1cd-98d0-5a68-bb91-97a0376e72fe with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e32be1cd-98d0-5a68-bb91-97a0376e72fe, identifier: BF26414
2026-03-28 11:09:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414
2026-03-28 11:09:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414
2026-03-28 11:09:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e32be1cd-98d0-5a68-bb91-97a0376e72fe with identifier: BF26414 to the API
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'diesel',
 'id': 'e32be1cd-98d0-5a68-bb91-97a0376e72fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF26414',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 140735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-04',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Saving data for BF26414: {'auction_closing_time': 1774716963.0, 'created_time': 1773306051.811419, 'last_price_update_time': 1774696158.201772}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF26414') HTTP/1.1" 204 0
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: WP35313
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Scrape type for BR24647: 2
2026-03-28 11:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647
2026-03-28 11:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 867c14e7-d7da-5f28-89f0-2b601d5d4351 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 867c14e7-d7da-5f28-89f0-2b601d5d4351 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 867c14e7-d7da-5f28-89f0-2b601d5d4351, identifier: BR24647
2026-03-28 11:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647
2026-03-28 11:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647
2026-03-28 11:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 867c14e7-d7da-5f28-89f0-2b601d5d4351 with identifier: BR24647 to the API
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:42:28Z',
 'fuel_type': 'petrol',
 'id': '867c14e7-d7da-5f28-89f0-2b601d5d4351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR24647',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 30706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2021}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Saving data for BR24647: {'auction_closing_time': 1774716148.0, 'created_time': 1773302856.422645, 'last_price_update_time': 1774696158.682186}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR24647') HTTP/1.1" 204 0
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-28 11:09:18 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [auto1.de] INFO: Scrape type for RX49945: 2
2026-03-28 11:09:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945
2026-03-28 11:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c519ae2b-43ea-5bcb-bf09-a230dbcded80 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c519ae2b-43ea-5bcb-bf09-a230dbcded80 with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c519ae2b-43ea-5bcb-bf09-a230dbcded80, identifier: RX49945
2026-03-28 11:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945
2026-03-28 11:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945
2026-03-28 11:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c519ae2b-43ea-5bcb-bf09-a230dbcded80 with identifier: RX49945 to the API
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-28T16:37:25Z',
 'fuel_type': 'diesel',
 'id': 'c519ae2b-43ea-5bcb-bf09-a230dbcded80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX49945',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 84708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six 4Motion',
 'transmission': 'automatic',
 'trim': 'Generation Six 4Motion',
 'year': 2019}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.de] INFO: Saving data for RX49945: {'auction_closing_time': 1774715845.0, 'created_time': 1773307362.034399, 'last_price_update_time': 1774696159.124022}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX49945') HTTP/1.1" 204 0
2026-03-28 11:09:19 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.de] INFO: Scrape type for WX13584: 2
2026-03-28 11:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584
2026-03-28 11:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with scrape type 2
2026-03-28 11:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e93d99ec-6416-560c-8d3d-f92d0d7a68b5, identifier: WX13584
2026-03-28 11:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584
2026-03-28 11:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584
2026-03-28 11:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e93d99ec-6416-560c-8d3d-f92d0d7a68b5 with identifier: WX13584 to the API
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:39:47Z',
 'fuel_type': 'petrol',
 'id': 'e93d99ec-6416-560c-8d3d-f92d0d7a68b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX13584',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 49057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-21',
 'seller_name': None,
 'title': 'Fiat 500 0.9 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [auto1.de] INFO: Saving data for WX13584: {'auction_closing_time': 1774715987.0, 'created_time': 1774292306.281234, 'last_price_update_time': 1774696159.644875}
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX13584') HTTP/1.1" 204 0
2026-03-28 11:09:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:25 [auto1.de] INFO: Channel: 24h | Page: 211 | totalHits: 9707 | hits on page: 40
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Scrape type for WX13584: 0
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Scrape type for NK53054: 2
2026-03-28 11:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054
2026-03-28 11:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96419e94-377d-57d7-9b8a-a7e029e76ed9 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96419e94-377d-57d7-9b8a-a7e029e76ed9 with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96419e94-377d-57d7-9b8a-a7e029e76ed9, identifier: NK53054
2026-03-28 11:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054
2026-03-28 11:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054
2026-03-28 11:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96419e94-377d-57d7-9b8a-a7e029e76ed9 with identifier: NK53054 to the API
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:08:57Z',
 'fuel_type': 'petrol',
 'id': '96419e94-377d-57d7-9b8a-a7e029e76ed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK53054',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 83922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-16',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Club BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Club BlueMotion Tech',
 'year': 2016}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Saving data for NK53054: {'auction_closing_time': 1774714137.0, 'created_time': 1774608083.567906, 'last_price_update_time': 1774696165.501451}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK53054') HTTP/1.1" 204 0
2026-03-28 11:09:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Scrape type for JM73266: 2
2026-03-28 11:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266
2026-03-28 11:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aebe9bb2-caa1-56ab-8a0c-652c0810d20a with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aebe9bb2-caa1-56ab-8a0c-652c0810d20a with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aebe9bb2-caa1-56ab-8a0c-652c0810d20a, identifier: JM73266
2026-03-28 11:09:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266
2026-03-28 11:09:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266
2026-03-28 11:09:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aebe9bb2-caa1-56ab-8a0c-652c0810d20a with identifier: JM73266 to the API
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:56:37Z',
 'fuel_type': 'diesel',
 'id': 'aebe9bb2-caa1-56ab-8a0c-652c0810d20a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM73266',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 278252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2015}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Saving data for JM73266: {'auction_closing_time': 1774716997.0, 'created_time': 1773686258.796828, 'last_price_update_time': 1774696165.934027}
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM73266') HTTP/1.1" 204 0
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-28 11:09:25 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-28 11:09:25 [auto1.de] INFO: Scrape type for KM67977: 2
2026-03-28 11:09:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977
2026-03-28 11:09:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06d80ea7-a34e-5aae-afcf-dff2e9401bda with scrape type 2
2026-03-28 11:09:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06d80ea7-a34e-5aae-afcf-dff2e9401bda with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06d80ea7-a34e-5aae-afcf-dff2e9401bda, identifier: KM67977
2026-03-28 11:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977
2026-03-28 11:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977
2026-03-28 11:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06d80ea7-a34e-5aae-afcf-dff2e9401bda with identifier: KM67977 to the API
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:37:49Z',
 'fuel_type': 'diesel',
 'id': '06d80ea7-a34e-5aae-afcf-dff2e9401bda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM67977',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 144554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Alltrack BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'Alltrack BlueMotion 4Motion',
 'year': 2017}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.de] INFO: Saving data for KM67977: {'auction_closing_time': 1774715869.0, 'created_time': 1774264835.565672, 'last_price_update_time': 1774696166.405377}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM67977') HTTP/1.1" 204 0
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.de] INFO: Scrape type for JV63052: 2
2026-03-28 11:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052
2026-03-28 11:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2775f533-8a1d-568a-9f06-dabd22d7b9b8, identifier: JV63052
2026-03-28 11:09:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052
2026-03-28 11:09:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052
2026-03-28 11:09:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2775f533-8a1d-568a-9f06-dabd22d7b9b8 with identifier: JV63052 to the API
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:13:13Z',
 'fuel_type': 'hybrid',
 'id': '2775f533-8a1d-568a-9f06-dabd22d7b9b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV63052',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 109185,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 Plug-in Hybrid Sportline iV',
 'transmission': 'automatic',
 'trim': 'Sportline iV',
 'year': 2021}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.de] INFO: Saving data for JV63052: {'auction_closing_time': 1774714393.0, 'created_time': 1773304030.229244, 'last_price_update_time': 1774696166.821281}
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV63052') HTTP/1.1" 204 0
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-28 11:09:26 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-28 11:09:26 [auto1.de] INFO: Scrape type for CZ66164: 2
2026-03-28 11:09:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164
2026-03-28 11:09:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6925f432-851a-527b-9873-a8d4e5692c61 with scrape type 2
2026-03-28 11:09:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6925f432-851a-527b-9873-a8d4e5692c61 with scrape type 2
2026-03-28 11:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6925f432-851a-527b-9873-a8d4e5692c61, identifier: CZ66164
2026-03-28 11:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164
2026-03-28 11:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164
2026-03-28 11:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6925f432-851a-527b-9873-a8d4e5692c61 with identifier: CZ66164 to the API
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:13:51Z',
 'fuel_type': 'petrol',
 'id': '6925f432-851a-527b-9873-a8d4e5692c61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ66164',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 78991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-13',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.de] INFO: Saving data for CZ66164: {'auction_closing_time': 1774714431.0, 'created_time': 1773858950.525664, 'last_price_update_time': 1774696167.372611}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ66164') HTTP/1.1" 204 0
2026-03-28 11:09:27 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-28 11:09:27 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-28 11:09:27 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-28 11:09:27 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.de] INFO: Scrape type for JH37191: 2
2026-03-28 11:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191
2026-03-28 11:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with scrape type 2
2026-03-28 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with scrape type 2
2026-03-28 11:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e, identifier: JH37191
2026-03-28 11:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191
2026-03-28 11:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191
2026-03-28 11:09:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1bd3a18-e3ab-51c4-be0b-f9150f153f4e with identifier: JH37191 to the API
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:23:27Z',
 'fuel_type': 'petrol',
 'id': 'a1bd3a18-e3ab-51c4-be0b-f9150f153f4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH37191',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 123424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-12',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2017}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.de] INFO: Saving data for JH37191: {'auction_closing_time': 1774715007.0, 'created_time': 1773305419.374864, 'last_price_update_time': 1774696167.776664}
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH37191') HTTP/1.1" 204 0
2026-03-28 11:09:27 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-28 11:09:27 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-28 11:09:27 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [auto1.de] INFO: Scrape type for TJ39363: 2
2026-03-28 11:09:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363
2026-03-28 11:09:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97a649c8-8819-5f61-b364-b382601f4676 with scrape type 2
2026-03-28 11:09:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97a649c8-8819-5f61-b364-b382601f4676 with scrape type 2
2026-03-28 11:09:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97a649c8-8819-5f61-b364-b382601f4676, identifier: TJ39363
2026-03-28 11:09:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363
2026-03-28 11:09:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363
2026-03-28 11:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97a649c8-8819-5f61-b364-b382601f4676 with identifier: TJ39363 to the API
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:37:33Z',
 'fuel_type': 'diesel',
 'id': '97a649c8-8819-5f61-b364-b382601f4676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ39363',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 198552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-12',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.de] INFO: Saving data for TJ39363: {'auction_closing_time': 1774715853.0, 'created_time': 1773686339.757991, 'last_price_update_time': 1774696168.202946}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ39363') HTTP/1.1" 204 0
2026-03-28 11:09:28 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.de] INFO: Scrape type for UV04147: 2
2026-03-28 11:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147
2026-03-28 11:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2d72083-c6bb-57af-b98d-4037629982b2 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2d72083-c6bb-57af-b98d-4037629982b2 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2d72083-c6bb-57af-b98d-4037629982b2, identifier: UV04147
2026-03-28 11:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147
2026-03-28 11:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147
2026-03-28 11:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2d72083-c6bb-57af-b98d-4037629982b2 with identifier: UV04147 to the API
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:59:08Z',
 'fuel_type': 'petrol',
 'id': 'b2d72083-c6bb-57af-b98d-4037629982b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV04147',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 209674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.de] INFO: Saving data for UV04147: {'auction_closing_time': 1774717148.0, 'created_time': 1773305741.047526, 'last_price_update_time': 1774696168.759841}
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV04147') HTTP/1.1" 204 0
2026-03-28 11:09:28 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [auto1.de] INFO: Scrape type for SC19815: 2
2026-03-28 11:09:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815
2026-03-28 11:09:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d302ed0-f97e-5724-b442-502b501d15a4 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d302ed0-f97e-5724-b442-502b501d15a4 with scrape type 2
2026-03-28 11:09:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d302ed0-f97e-5724-b442-502b501d15a4, identifier: SC19815
2026-03-28 11:09:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815
2026-03-28 11:09:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815
2026-03-28 11:09:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d302ed0-f97e-5724-b442-502b501d15a4 with identifier: SC19815 to the API
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:09Z',
 'fuel_type': 'petrol',
 'id': '1d302ed0-f97e-5724-b442-502b501d15a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC19815',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 49132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-15',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2019}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.de] INFO: Saving data for SC19815: {'auction_closing_time': 1774715949.0, 'created_time': 1773689006.285639, 'last_price_update_time': 1774696169.182741}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC19815') HTTP/1.1" 204 0
2026-03-28 11:09:29 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.de] INFO: Scrape type for KN66940: 2
2026-03-28 11:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940
2026-03-28 11:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd42c97-d63b-5e49-a331-c4f704c080bf with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd42c97-d63b-5e49-a331-c4f704c080bf with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cd42c97-d63b-5e49-a331-c4f704c080bf, identifier: KN66940
2026-03-28 11:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940
2026-03-28 11:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940
2026-03-28 11:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cd42c97-d63b-5e49-a331-c4f704c080bf with identifier: KN66940 to the API
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:13:53Z',
 'fuel_type': 'diesel',
 'id': '5cd42c97-d63b-5e49-a331-c4f704c080bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN66940',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 228471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-31',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 113 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2012}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.de] INFO: Saving data for KN66940: {'auction_closing_time': 1774714433.0, 'created_time': 1773831041.714024, 'last_price_update_time': 1774696169.646198}
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN66940') HTTP/1.1" 204 0
2026-03-28 11:09:29 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-28 11:09:29 [auto1.de] INFO: Scrape type for BC36387: 2
2026-03-28 11:09:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387
2026-03-28 11:09:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19bd8017-e7b4-51a2-9694-36cb39d848fd with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19bd8017-e7b4-51a2-9694-36cb39d848fd with scrape type 2
2026-03-28 11:09:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19bd8017-e7b4-51a2-9694-36cb39d848fd, identifier: BC36387
2026-03-28 11:09:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387
2026-03-28 11:09:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387
2026-03-28 11:09:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19bd8017-e7b4-51a2-9694-36cb39d848fd with identifier: BC36387 to the API
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:18:34Z',
 'fuel_type': 'petrol',
 'id': '19bd8017-e7b4-51a2-9694-36cb39d848fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC36387',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 120942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-01-23',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Saving data for BC36387: {'auction_closing_time': 1774714714.0, 'created_time': 1773859125.080912, 'last_price_update_time': 1774696170.074621}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC36387') HTTP/1.1" 204 0
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Scrape type for AZ50044: 2
2026-03-28 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044
2026-03-28 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498896fd-63c0-565b-86e8-6e75805e561b with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 498896fd-63c0-565b-86e8-6e75805e561b with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 498896fd-63c0-565b-86e8-6e75805e561b, identifier: AZ50044
2026-03-28 11:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044
2026-03-28 11:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044
2026-03-28 11:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 498896fd-63c0-565b-86e8-6e75805e561b with identifier: AZ50044 to the API
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:01:41Z',
 'fuel_type': 'diesel',
 'id': '498896fd-63c0-565b-86e8-6e75805e561b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ50044',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 335881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2010}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Saving data for AZ50044: {'auction_closing_time': 1774713701.0, 'created_time': 1774291892.600597, 'last_price_update_time': 1774696170.504067}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ50044') HTTP/1.1" 204 0
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Scrape type for UH90150: 2
2026-03-28 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150
2026-03-28 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8, identifier: UH90150
2026-03-28 11:09:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150
2026-03-28 11:09:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150
2026-03-28 11:09:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eacf758b-42e1-5391-97c3-6f3dfe5ad8b8 with identifier: UH90150 to the API
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:45:01Z',
 'fuel_type': 'diesel',
 'id': 'eacf758b-42e1-5391-97c3-6f3dfe5ad8b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH90150',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 208948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-19',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Saving data for UH90150: {'auction_closing_time': 1774716301.0, 'created_time': 1773382975.748667, 'last_price_update_time': 1774696170.920826}
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH90150') HTTP/1.1" 204 0
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-28 11:09:30 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-28 11:09:30 [auto1.de] INFO: Scrape type for XS31792: 2
2026-03-28 11:09:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792
2026-03-28 11:09:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with scrape type 2
2026-03-28 11:09:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with scrape type 2
2026-03-28 11:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a, identifier: XS31792
2026-03-28 11:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792
2026-03-28 11:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792
2026-03-28 11:09:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a302eb6-04ad-5d88-9cef-63b3bda3f28a with identifier: XS31792 to the API
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:17:48Z',
 'fuel_type': 'petrol',
 'id': '8a302eb6-04ad-5d88-9cef-63b3bda3f28a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS31792',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 120214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': None,
 'title': 'Audi A6 45 TFSI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [auto1.de] INFO: Saving data for XS31792: {'auction_closing_time': 1774714668.0, 'created_time': 1773303155.605887, 'last_price_update_time': 1774696171.659792}
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS31792') HTTP/1.1" 204 0
2026-03-28 11:09:31 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [auto1.de] INFO: Scrape type for YH72749: 2
2026-03-28 11:09:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749
2026-03-28 11:09:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38027e4-da34-5c38-ad8b-832c485af082 with scrape type 2
2026-03-28 11:09:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38027e4-da34-5c38-ad8b-832c485af082 with scrape type 2
2026-03-28 11:09:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a38027e4-da34-5c38-ad8b-832c485af082, identifier: YH72749
2026-03-28 11:09:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749
2026-03-28 11:09:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749
2026-03-28 11:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a38027e4-da34-5c38-ad8b-832c485af082 with identifier: YH72749 to the API
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:44:55Z',
 'fuel_type': 'petrol',
 'id': 'a38027e4-da34-5c38-ad8b-832c485af082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH72749',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 99121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-21',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2012}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.de] INFO: Saving data for YH72749: {'auction_closing_time': 1774716295.0, 'created_time': 1773772543.630966, 'last_price_update_time': 1774696172.192482}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH72749') HTTP/1.1" 204 0
2026-03-28 11:09:32 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-28 11:09:32 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.de] INFO: Scrape type for FK36654: 2
2026-03-28 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654
2026-03-28 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e, identifier: FK36654
2026-03-28 11:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654
2026-03-28 11:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654
2026-03-28 11:09:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e98327a-4893-5aa9-a9a1-70c274d8dc4e with identifier: FK36654 to the API
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:07:43Z',
 'fuel_type': 'diesel',
 'id': '0e98327a-4893-5aa9-a9a1-70c274d8dc4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK36654',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 160711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-03',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 2.0 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.de] INFO: Saving data for FK36654: {'auction_closing_time': 1774714063.0, 'created_time': 1774293273.349653, 'last_price_update_time': 1774696172.627184}
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK36654') HTTP/1.1" 204 0
2026-03-28 11:09:32 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [auto1.de] INFO: Scrape type for KP12697: 2
2026-03-28 11:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697
2026-03-28 11:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af85f408-3e5e-5540-9aab-d1b321ece4b1 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af85f408-3e5e-5540-9aab-d1b321ece4b1 with scrape type 2
2026-03-28 11:09:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af85f408-3e5e-5540-9aab-d1b321ece4b1, identifier: KP12697
2026-03-28 11:09:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697
2026-03-28 11:09:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697
2026-03-28 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af85f408-3e5e-5540-9aab-d1b321ece4b1 with identifier: KP12697 to the API
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:22:04Z',
 'fuel_type': 'petrol',
 'id': 'af85f408-3e5e-5540-9aab-d1b321ece4b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP12697',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 181041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-06',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2011}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.de] INFO: Saving data for KP12697: {'auction_closing_time': 1774714924.0, 'created_time': 1772544480.903056, 'last_price_update_time': 1774696173.280285}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP12697') HTTP/1.1" 204 0
2026-03-28 11:09:33 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.de] INFO: Scrape type for BS83474: 2
2026-03-28 11:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474
2026-03-28 11:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c0f230c-2673-5c6a-850b-1043a2580dfb with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c0f230c-2673-5c6a-850b-1043a2580dfb with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c0f230c-2673-5c6a-850b-1043a2580dfb, identifier: BS83474
2026-03-28 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474
2026-03-28 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474
2026-03-28 11:09:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c0f230c-2673-5c6a-850b-1043a2580dfb with identifier: BS83474 to the API
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:36:51Z',
 'fuel_type': 'diesel',
 'id': '9c0f230c-2673-5c6a-850b-1043a2580dfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS83474',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 184613,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-20',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2017}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.de] INFO: Saving data for BS83474: {'auction_closing_time': 1774715811.0, 'created_time': 1772543696.739905, 'last_price_update_time': 1774696173.737553}
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS83474') HTTP/1.1" 204 0
2026-03-28 11:09:33 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [auto1.de] INFO: Scrape type for WC52225: 2
2026-03-28 11:09:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225
2026-03-28 11:09:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with scrape type 2
2026-03-28 11:09:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f, identifier: WC52225
2026-03-28 11:09:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225
2026-03-28 11:09:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225
2026-03-28 11:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b433e72-a5e0-54ef-8eb0-cb54c1041f3f with identifier: WC52225 to the API
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:33:47Z',
 'fuel_type': 'petrol',
 'id': '2b433e72-a5e0-54ef-8eb0-cb54c1041f3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC52225',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 115829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2018}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.de] INFO: Saving data for WC52225: {'auction_closing_time': 1774715627.0, 'created_time': 1773861700.769657, 'last_price_update_time': 1774696174.179146}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC52225') HTTP/1.1" 204 0
2026-03-28 11:09:34 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.de] INFO: Scrape type for XX81034: 2
2026-03-28 11:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034
2026-03-28 11:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2587d3d4-9854-57c2-a48f-fd751d94b628 with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2587d3d4-9854-57c2-a48f-fd751d94b628 with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2587d3d4-9854-57c2-a48f-fd751d94b628, identifier: XX81034
2026-03-28 11:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034
2026-03-28 11:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034
2026-03-28 11:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2587d3d4-9854-57c2-a48f-fd751d94b628 with identifier: XX81034 to the API
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-28T16:08:54Z',
 'fuel_type': 'diesel',
 'id': '2587d3d4-9854-57c2-a48f-fd751d94b628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX81034',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 221216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-01',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Ocean Race AWD',
 'transmission': 'automatic',
 'trim': 'Ocean Race AWD',
 'year': 2012}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.de] INFO: Saving data for XX81034: {'auction_closing_time': 1774714134.0, 'created_time': 1773774223.806507, 'last_price_update_time': 1774696174.656672}
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX81034') HTTP/1.1" 204 0
2026-03-28 11:09:34 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-28 11:09:34 [auto1.de] INFO: Scrape type for BP39163: 2
2026-03-28 11:09:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163
2026-03-28 11:09:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01d229ff-9da3-5223-935e-9efaab1f9dfb with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01d229ff-9da3-5223-935e-9efaab1f9dfb with scrape type 2
2026-03-28 11:09:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01d229ff-9da3-5223-935e-9efaab1f9dfb, identifier: BP39163
2026-03-28 11:09:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163
2026-03-28 11:09:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163
2026-03-28 11:09:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01d229ff-9da3-5223-935e-9efaab1f9dfb with identifier: BP39163 to the API
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:19:08Z',
 'fuel_type': 'petrol',
 'id': '01d229ff-9da3-5223-935e-9efaab1f9dfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP39163',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 69580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport P200 Mild-Hybrid S AWD',
 'transmission': 'automatic',
 'trim': 'S AWD',
 'year': 2020}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-28 11:09:35 [auto1.de] INFO: Saving data for BP39163: {'auction_closing_time': 1774714748.0, 'created_time': 1773687721.834316, 'last_price_update_time': 1774696175.083446}
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP39163') HTTP/1.1" 204 0
2026-03-28 11:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:39 [auto1.de] INFO: Channel: 24h | Page: 212 | totalHits: 9708 | hits on page: 40
2026-03-28 11:09:39 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.de] INFO: Scrape type for BP39163: 0
2026-03-28 11:09:39 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-28 11:09:39 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-28 11:09:39 [auto1.de] INFO: Scrape type for EL79145: 2
2026-03-28 11:09:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145
2026-03-28 11:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with scrape type 2
2026-03-28 11:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d, identifier: EL79145
2026-03-28 11:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145
2026-03-28 11:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145
2026-03-28 11:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d with identifier: EL79145 to the API
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:38:14Z',
 'fuel_type': 'petrol',
 'id': 'e1ff8fbe-6f12-5176-81c2-6b12c6e8e40d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL79145',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 96873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TSI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2020}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Saving data for EL79145: {'auction_closing_time': 1774715894.0, 'created_time': 1773861753.65887, 'last_price_update_time': 1774696180.250763}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL79145') HTTP/1.1" 204 0
2026-03-28 11:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: DM09688
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Scrape type for LK89545: 2
2026-03-28 11:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545
2026-03-28 11:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb70ee21-5451-5415-98ab-70362eaed48a with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb70ee21-5451-5415-98ab-70362eaed48a with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb70ee21-5451-5415-98ab-70362eaed48a, identifier: LK89545
2026-03-28 11:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545
2026-03-28 11:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545
2026-03-28 11:09:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb70ee21-5451-5415-98ab-70362eaed48a with identifier: LK89545 to the API
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:09:17Z',
 'fuel_type': 'diesel',
 'id': 'bb70ee21-5451-5415-98ab-70362eaed48a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK89545',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 149381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-22',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2019}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Saving data for LK89545: {'auction_closing_time': 1774714157.0, 'created_time': 1774251386.456911, 'last_price_update_time': 1774696180.854019}
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK89545') HTTP/1.1" 204 0
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-28 11:09:40 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-28 11:09:40 [auto1.de] INFO: Scrape type for JA64656: 2
2026-03-28 11:09:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656
2026-03-28 11:09:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 971d896d-b74a-5e01-b383-eff0db2ce72b with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 971d896d-b74a-5e01-b383-eff0db2ce72b with scrape type 2
2026-03-28 11:09:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 971d896d-b74a-5e01-b383-eff0db2ce72b, identifier: JA64656
2026-03-28 11:09:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656
2026-03-28 11:09:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656
2026-03-28 11:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 971d896d-b74a-5e01-b383-eff0db2ce72b with identifier: JA64656 to the API
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:29:52Z',
 'fuel_type': 'petrol',
 'id': '971d896d-b74a-5e01-b383-eff0db2ce72b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA64656',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 113122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-08',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.de] INFO: Saving data for JA64656: {'auction_closing_time': 1774715392.0, 'created_time': 1773686205.133328, 'last_price_update_time': 1774696181.276724}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA64656') HTTP/1.1" 204 0
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: GT54447
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.de] INFO: Scrape type for SJ09412: 2
2026-03-28 11:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412
2026-03-28 11:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363, identifier: SJ09412
2026-03-28 11:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412
2026-03-28 11:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412
2026-03-28 11:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b4c5809-2e22-5eb9-94e9-06b3bee7f363 with identifier: SJ09412 to the API
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:45:10Z',
 'fuel_type': 'diesel',
 'id': '9b4c5809-2e22-5eb9-94e9-06b3bee7f363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ09412',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 209333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-05',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.de] INFO: Saving data for SJ09412: {'auction_closing_time': 1774716310.0, 'created_time': 1774262913.05438, 'last_price_update_time': 1774696181.701512}
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ09412') HTTP/1.1" 204 0
2026-03-28 11:09:41 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [auto1.de] INFO: Scrape type for PZ64082: 2
2026-03-28 11:09:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082
2026-03-28 11:09:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 930329d9-c3c2-5584-ac29-37e14b628783 with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 930329d9-c3c2-5584-ac29-37e14b628783 with scrape type 2
2026-03-28 11:09:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 930329d9-c3c2-5584-ac29-37e14b628783, identifier: PZ64082
2026-03-28 11:09:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082
2026-03-28 11:09:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082
2026-03-28 11:09:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 930329d9-c3c2-5584-ac29-37e14b628783 with identifier: PZ64082 to the API
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:36:50Z',
 'fuel_type': 'diesel',
 'id': '930329d9-c3c2-5584-ac29-37e14b628783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ64082',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 238797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.de] INFO: Saving data for PZ64082: {'auction_closing_time': 1774715810.0, 'created_time': 1774265340.259852, 'last_price_update_time': 1774696182.170785}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ64082') HTTP/1.1" 204 0
2026-03-28 11:09:42 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.de] INFO: Scrape type for DL95499: 2
2026-03-28 11:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499
2026-03-28 11:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c248a85-2033-5e21-80c8-16b658fa9f0b with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c248a85-2033-5e21-80c8-16b658fa9f0b with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c248a85-2033-5e21-80c8-16b658fa9f0b, identifier: DL95499
2026-03-28 11:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499
2026-03-28 11:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499
2026-03-28 11:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c248a85-2033-5e21-80c8-16b658fa9f0b with identifier: DL95499 to the API
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:47:44Z',
 'fuel_type': 'diesel',
 'id': '7c248a85-2033-5e21-80c8-16b658fa9f0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL95499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 242886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.de] INFO: Saving data for DL95499: {'auction_closing_time': 1774716464.0, 'created_time': 1773830263.126836, 'last_price_update_time': 1774696182.61736}
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL95499') HTTP/1.1" 204 0
2026-03-28 11:09:42 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-28 11:09:42 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-28 11:09:42 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-28 11:09:42 [auto1.de] INFO: Found listing with ID: TW84588
2026-03-28 11:09:42 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [auto1.de] INFO: Scrape type for ZY13516: 2
2026-03-28 11:09:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516
2026-03-28 11:09:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a080e24-4ed6-588a-a4ab-8331d736c3ae with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a080e24-4ed6-588a-a4ab-8331d736c3ae with scrape type 2
2026-03-28 11:09:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a080e24-4ed6-588a-a4ab-8331d736c3ae, identifier: ZY13516
2026-03-28 11:09:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516
2026-03-28 11:09:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516
2026-03-28 11:09:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a080e24-4ed6-588a-a4ab-8331d736c3ae with identifier: ZY13516 to the API
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:19Z',
 'fuel_type': 'petrol',
 'id': '2a080e24-4ed6-588a-a4ab-8331d736c3ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY13516',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 251247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-22',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.de] INFO: Saving data for ZY13516: {'auction_closing_time': 1774714999.0, 'created_time': 1773383143.923159, 'last_price_update_time': 1774696183.153329}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY13516') HTTP/1.1" 204 0
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: VM43459
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM43459%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.de] INFO: Scrape type for VM43459: 2
2026-03-28 11:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ed79bab-fe39-53ef-84f8-820605009848 with identifier: VM43459
2026-03-28 11:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ed79bab-fe39-53ef-84f8-820605009848 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ed79bab-fe39-53ef-84f8-820605009848 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ed79bab-fe39-53ef-84f8-820605009848, identifier: VM43459
2026-03-28 11:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ed79bab-fe39-53ef-84f8-820605009848 with identifier: VM43459
2026-03-28 11:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ed79bab-fe39-53ef-84f8-820605009848 with identifier: VM43459
2026-03-28 11:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ed79bab-fe39-53ef-84f8-820605009848 with identifier: VM43459 to the API
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:06:17Z',
 'fuel_type': 'diesel',
 'id': '2ed79bab-fe39-53ef-84f8-820605009848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM43459',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Exeo',
 'odometer': 274445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-09',
 'seller_name': None,
 'title': 'Seat Exeo 2.0 TDI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2011}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM43459%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.de] INFO: Saving data for VM43459: {'auction_closing_time': 1774713977.0, 'created_time': 1774263759.33833, 'last_price_update_time': 1774696183.588521}
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM43459') HTTP/1.1" 204 0
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-28 11:09:43 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [auto1.de] INFO: Scrape type for VY28868: 2
2026-03-28 11:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868
2026-03-28 11:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32d40a9-15fa-500c-b0f4-60221c3e94a7 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32d40a9-15fa-500c-b0f4-60221c3e94a7 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c32d40a9-15fa-500c-b0f4-60221c3e94a7, identifier: VY28868
2026-03-28 11:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868
2026-03-28 11:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868
2026-03-28 11:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c32d40a9-15fa-500c-b0f4-60221c3e94a7 with identifier: VY28868 to the API
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:35:08Z',
 'fuel_type': 'petrol',
 'id': 'c32d40a9-15fa-500c-b0f4-60221c3e94a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY28868',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 64405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2021}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.de] INFO: Saving data for VY28868: {'auction_closing_time': 1774715708.0, 'created_time': 1773308350.783117, 'last_price_update_time': 1774696184.078905}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY28868') HTTP/1.1" 204 0
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.de] INFO: Scrape type for FS96919: 2
2026-03-28 11:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919
2026-03-28 11:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c, identifier: FS96919
2026-03-28 11:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919
2026-03-28 11:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919
2026-03-28 11:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11f5240c-8f9d-5c93-ab4c-1219b1cea46c with identifier: FS96919 to the API
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:23:00Z',
 'fuel_type': 'petrol',
 'id': '11f5240c-8f9d-5c93-ab4c-1219b1cea46c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS96919',
 'listing': 'auction',
 'make': 'Daihatsu',
 'model': 'Sirion',
 'odometer': 128330,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-14',
 'seller_name': None,
 'title': 'Daihatsu Sirion 1.3',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.de] INFO: Saving data for FS96919: {'auction_closing_time': 1774714980.0, 'created_time': 1773775082.393337, 'last_price_update_time': 1774696184.591305}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS96919') HTTP/1.1" 204 0
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-28 11:09:44 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [auto1.de] INFO: Scrape type for MT56584: 2
2026-03-28 11:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584
2026-03-28 11:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 056e708f-fade-5e36-a291-087ac51a274b with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 056e708f-fade-5e36-a291-087ac51a274b with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 056e708f-fade-5e36-a291-087ac51a274b, identifier: MT56584
2026-03-28 11:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584
2026-03-28 11:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584
2026-03-28 11:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 056e708f-fade-5e36-a291-087ac51a274b with identifier: MT56584 to the API
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:11:48Z',
 'fuel_type': 'petrol',
 'id': '056e708f-fade-5e36-a291-087ac51a274b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT56584',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 155013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-13',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Monte Carlo',
 'transmission': 'manual',
 'trim': 'Monte Carlo',
 'year': 2013}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.de] INFO: Saving data for MT56584: {'auction_closing_time': 1774714308.0, 'created_time': 1774293430.642372, 'last_price_update_time': 1774696185.074973}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT56584') HTTP/1.1" 204 0
2026-03-28 11:09:45 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-28 11:09:45 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-28 11:09:45 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.de] INFO: Scrape type for LB25198: 2
2026-03-28 11:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198
2026-03-28 11:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df76649b-e3e6-5f74-81f2-16f1dee725e3 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df76649b-e3e6-5f74-81f2-16f1dee725e3 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df76649b-e3e6-5f74-81f2-16f1dee725e3, identifier: LB25198
2026-03-28 11:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198
2026-03-28 11:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198
2026-03-28 11:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df76649b-e3e6-5f74-81f2-16f1dee725e3 with identifier: LB25198 to the API
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-28T16:34:54Z',
 'fuel_type': 'diesel',
 'id': 'df76649b-e3e6-5f74-81f2-16f1dee725e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB25198',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ7',
 'odometer': 158917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-22',
 'seller_name': None,
 'title': 'Audi SQ7 4.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.de] INFO: Saving data for LB25198: {'auction_closing_time': 1774715694.0, 'created_time': 1773861387.901099, 'last_price_update_time': 1774696185.671984}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB25198') HTTP/1.1" 204 0
2026-03-28 11:09:45 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-28 11:09:45 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-28 11:09:45 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [auto1.de] INFO: Scrape type for FP92588: 2
2026-03-28 11:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588
2026-03-28 11:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efa3c882-164d-5314-acbc-ed8d77b17f77 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efa3c882-164d-5314-acbc-ed8d77b17f77 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efa3c882-164d-5314-acbc-ed8d77b17f77, identifier: FP92588
2026-03-28 11:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588
2026-03-28 11:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588
2026-03-28 11:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efa3c882-164d-5314-acbc-ed8d77b17f77 with identifier: FP92588 to the API
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:00:23Z',
 'fuel_type': 'petrol',
 'id': 'efa3c882-164d-5314-acbc-ed8d77b17f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP92588',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 66848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-18',
 'seller_name': None,
 'title': 'Honda Civic 2.0 VTEC Type-R GT',
 'transmission': 'manual',
 'trim': 'Type-R GT',
 'year': 2018}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.de] INFO: Saving data for FP92588: {'auction_closing_time': 1774713623.0, 'created_time': 1773400835.273956, 'last_price_update_time': 1774696186.30166}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP92588') HTTP/1.1" 204 0
2026-03-28 11:09:46 [auto1.de] INFO: Found listing with ID: HV11819
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV11819%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.de] INFO: Scrape type for HV11819: 2
2026-03-28 11:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45259066-683c-5962-b48c-293478f9b78f with identifier: HV11819
2026-03-28 11:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45259066-683c-5962-b48c-293478f9b78f with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45259066-683c-5962-b48c-293478f9b78f with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45259066-683c-5962-b48c-293478f9b78f, identifier: HV11819
2026-03-28 11:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45259066-683c-5962-b48c-293478f9b78f with identifier: HV11819
2026-03-28 11:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45259066-683c-5962-b48c-293478f9b78f with identifier: HV11819
2026-03-28 11:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45259066-683c-5962-b48c-293478f9b78f with identifier: HV11819 to the API
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:52:54Z',
 'fuel_type': 'diesel',
 'id': '45259066-683c-5962-b48c-293478f9b78f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV11819',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 106370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-04',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 EcoBlue TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2019}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV11819%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.de] INFO: Saving data for HV11819: {'auction_closing_time': 1774716774.0, 'created_time': 1773224542.883645, 'last_price_update_time': 1774696186.896323}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV11819') HTTP/1.1" 204 0
2026-03-28 11:09:46 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-28 11:09:46 [auto1.de] INFO: Found listing with ID: NE66332
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE66332%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [auto1.de] INFO: Scrape type for NE66332: 2
2026-03-28 11:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab5da82e-724a-586e-b7ef-180593adb7e7 with identifier: NE66332
2026-03-28 11:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab5da82e-724a-586e-b7ef-180593adb7e7 with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab5da82e-724a-586e-b7ef-180593adb7e7 with scrape type 2
2026-03-28 11:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab5da82e-724a-586e-b7ef-180593adb7e7, identifier: NE66332
2026-03-28 11:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab5da82e-724a-586e-b7ef-180593adb7e7 with identifier: NE66332
2026-03-28 11:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab5da82e-724a-586e-b7ef-180593adb7e7 with identifier: NE66332
2026-03-28 11:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab5da82e-724a-586e-b7ef-180593adb7e7 with identifier: NE66332 to the API
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:36:28Z',
 'fuel_type': 'petrol',
 'id': 'ab5da82e-724a-586e-b7ef-180593adb7e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE66332',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 128126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-20',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 Flexifuel Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE66332%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.de] INFO: Saving data for NE66332: {'auction_closing_time': 1774715788.0, 'created_time': 1774608200.071266, 'last_price_update_time': 1774696188.237436}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE66332') HTTP/1.1" 204 0
2026-03-28 11:09:48 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ99770%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.de] INFO: Scrape type for YJ99770: 0
2026-03-28 11:09:48 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-28 11:09:48 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.de] INFO: Scrape type for XB16241: 2
2026-03-28 11:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241
2026-03-28 11:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0572a376-77bf-51a3-93ef-8de2f8eb6a82, identifier: XB16241
2026-03-28 11:09:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241
2026-03-28 11:09:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241
2026-03-28 11:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0572a376-77bf-51a3-93ef-8de2f8eb6a82 with identifier: XB16241 to the API
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:02:51Z',
 'fuel_type': 'diesel',
 'id': '0572a376-77bf-51a3-93ef-8de2f8eb6a82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB16241',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 145715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-25',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Active Start/Stop',
 'transmission': 'manual',
 'trim': 'Active Start/Stop',
 'year': 2017}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.de] INFO: Saving data for XB16241: {'auction_closing_time': 1774713771.0, 'created_time': 1773775601.776793, 'last_price_update_time': 1774696188.728808}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB16241') HTTP/1.1" 204 0
2026-03-28 11:09:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:48 [auto1.de] INFO: Channel: 24h | Page: 213 | totalHits: 9707 | hits on page: 40
2026-03-28 11:09:48 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-28 11:09:48 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [auto1.de] INFO: Scrape type for EP05122: 2
2026-03-28 11:09:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122
2026-03-28 11:09:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7267485-db74-570b-a230-cc5d837feab2 with scrape type 2
2026-03-28 11:09:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7267485-db74-570b-a230-cc5d837feab2 with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7267485-db74-570b-a230-cc5d837feab2, identifier: EP05122
2026-03-28 11:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122
2026-03-28 11:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122
2026-03-28 11:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7267485-db74-570b-a230-cc5d837feab2 with identifier: EP05122 to the API
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:43:23Z',
 'fuel_type': 'diesel',
 'id': 'a7267485-db74-570b-a230-cc5d837feab2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP05122',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 238179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-21',
 'seller_name': None,
 'title': 'Opel Vectra 3.0 V6 CDTI Cosmo Plus',
 'transmission': 'automatic',
 'trim': 'Cosmo Plus',
 'year': 2007}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.de] INFO: Saving data for EP05122: {'auction_closing_time': 1774716203.0, 'created_time': 1773686292.837456, 'last_price_update_time': 1774696189.4378}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP05122') HTTP/1.1" 204 0
2026-03-28 11:09:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:49 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-28 11:09:49 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.de] INFO: Scrape type for MA81482: 2
2026-03-28 11:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482
2026-03-28 11:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710a572e-edd9-5abc-8bae-0b24e758d3ab with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710a572e-edd9-5abc-8bae-0b24e758d3ab with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710a572e-edd9-5abc-8bae-0b24e758d3ab, identifier: MA81482
2026-03-28 11:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482
2026-03-28 11:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482
2026-03-28 11:09:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710a572e-edd9-5abc-8bae-0b24e758d3ab with identifier: MA81482 to the API
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:15:59Z',
 'fuel_type': 'petrol',
 'id': '710a572e-edd9-5abc-8bae-0b24e758d3ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA81482',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 107265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-20',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.de] INFO: Saving data for MA81482: {'auction_closing_time': 1774714559.0, 'created_time': 1773402369.125346, 'last_price_update_time': 1774696189.851106}
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA81482') HTTP/1.1" 204 0
2026-03-28 11:09:49 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-28 11:09:49 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-28 11:09:49 [auto1.de] INFO: Scrape type for TJ83975: 2
2026-03-28 11:09:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975
2026-03-28 11:09:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with scrape type 2
2026-03-28 11:09:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6e319ce-b6fd-5a9f-9e4e-9272ce540652, identifier: TJ83975
2026-03-28 11:09:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975
2026-03-28 11:09:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975
2026-03-28 11:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6e319ce-b6fd-5a9f-9e4e-9272ce540652 with identifier: TJ83975 to the API
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:34:47Z',
 'fuel_type': 'diesel',
 'id': 'e6e319ce-b6fd-5a9f-9e4e-9272ce540652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ83975',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 212091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Chevrolet Cruze 2.0 Diesel LTZ',
 'transmission': 'automatic',
 'trim': 'LTZ',
 'year': 2013}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.de] INFO: Saving data for TJ83975: {'auction_closing_time': 1774715687.0, 'created_time': 1774291420.187291, 'last_price_update_time': 1774696190.296412}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ83975') HTTP/1.1" 204 0
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: HE81981
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.de] INFO: Scrape type for NN62521: 2
2026-03-28 11:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521
2026-03-28 11:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec, identifier: NN62521
2026-03-28 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521
2026-03-28 11:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521
2026-03-28 11:09:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3901b9a-4202-5c28-9f8c-178cdfe5d4ec with identifier: NN62521 to the API
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:31:34Z',
 'fuel_type': 'petrol',
 'id': 'e3901b9a-4202-5c28-9f8c-178cdfe5d4ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN62521',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 165137,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-24',
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.de] INFO: Saving data for NN62521: {'auction_closing_time': 1774715494.0, 'created_time': 1774608108.251702, 'last_price_update_time': 1774696190.786094}
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN62521') HTTP/1.1" 204 0
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: ZN02812
2026-03-28 11:09:50 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-28 11:09:50 [auto1.de] INFO: Scrape type for CW50467: 2
2026-03-28 11:09:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467
2026-03-28 11:09:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df07608e-c87f-5488-a469-d61f37992642 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df07608e-c87f-5488-a469-d61f37992642 with scrape type 2
2026-03-28 11:09:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df07608e-c87f-5488-a469-d61f37992642, identifier: CW50467
2026-03-28 11:09:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467
2026-03-28 11:09:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467
2026-03-28 11:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df07608e-c87f-5488-a469-d61f37992642 with identifier: CW50467 to the API
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:03:50Z',
 'fuel_type': 'petrol',
 'id': 'df07608e-c87f-5488-a469-d61f37992642',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW50467',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 281116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-11',
 'seller_name': None,
 'title': 'Toyota Avensis 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.de] INFO: Saving data for CW50467: {'auction_closing_time': 1774713830.0, 'created_time': 1774291204.065733, 'last_price_update_time': 1774696191.255175}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW50467') HTTP/1.1" 204 0
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.de] INFO: Scrape type for KH74255: 2
2026-03-28 11:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255
2026-03-28 11:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11029a6c-6e5f-562f-aff9-b34fe1b6565c with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11029a6c-6e5f-562f-aff9-b34fe1b6565c with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11029a6c-6e5f-562f-aff9-b34fe1b6565c, identifier: KH74255
2026-03-28 11:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255
2026-03-28 11:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255
2026-03-28 11:09:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11029a6c-6e5f-562f-aff9-b34fe1b6565c with identifier: KH74255 to the API
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:52:40Z',
 'fuel_type': 'petrol',
 'id': '11029a6c-6e5f-562f-aff9-b34fe1b6565c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH74255',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 15350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-23',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2024}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.de] INFO: Saving data for KH74255: {'auction_closing_time': 1774716760.0, 'created_time': 1773305913.564122, 'last_price_update_time': 1774696191.842472}
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH74255') HTTP/1.1" 204 0
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-28 11:09:51 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-28 11:09:51 [auto1.de] INFO: Scrape type for KA22944: 2
2026-03-28 11:09:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944
2026-03-28 11:09:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffe7bf2c-8332-5993-a017-b632a06576a0 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffe7bf2c-8332-5993-a017-b632a06576a0 with scrape type 2
2026-03-28 11:09:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffe7bf2c-8332-5993-a017-b632a06576a0, identifier: KA22944
2026-03-28 11:09:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944
2026-03-28 11:09:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944
2026-03-28 11:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffe7bf2c-8332-5993-a017-b632a06576a0 with identifier: KA22944 to the API
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 207,
 'expiration_date': '2026-03-28T16:48:34Z',
 'fuel_type': 'petrol',
 'id': 'ffe7bf2c-8332-5993-a017-b632a06576a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA22944',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 19724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-21',
 'seller_name': None,
 'title': 'Audi A1 Sportback 40 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.de] INFO: Saving data for KA22944: {'auction_closing_time': 1774716514.0, 'created_time': 1773302355.530143, 'last_price_update_time': 1774696192.330024}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA22944') HTTP/1.1" 204 0
2026-03-28 11:09:52 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-28 11:09:52 [auto1.de] INFO: Found listing with ID: SX47208
2026-03-28 11:09:52 [auto1.de] INFO: Found listing with ID: UN34708
2026-03-28 11:09:52 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.de] INFO: Scrape type for YA26169: 2
2026-03-28 11:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169
2026-03-28 11:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef283e63-9dec-5dd6-a117-903b00f9602c with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef283e63-9dec-5dd6-a117-903b00f9602c with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef283e63-9dec-5dd6-a117-903b00f9602c, identifier: YA26169
2026-03-28 11:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169
2026-03-28 11:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169
2026-03-28 11:09:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef283e63-9dec-5dd6-a117-903b00f9602c with identifier: YA26169 to the API
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:12Z',
 'fuel_type': 'petrol',
 'id': 'ef283e63-9dec-5dd6-a117-903b00f9602c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA26169',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 54778,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2022}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.de] INFO: Saving data for YA26169: {'auction_closing_time': 1774715712.0, 'created_time': 1773401405.254514, 'last_price_update_time': 1774696192.848604}
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA26169') HTTP/1.1" 204 0
2026-03-28 11:09:52 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-28 11:09:52 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-28 11:09:52 [auto1.de] INFO: Scrape type for MX79326: 2
2026-03-28 11:09:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326
2026-03-28 11:09:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebaa4533-b143-5fda-bf73-c29838d4feb1 with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebaa4533-b143-5fda-bf73-c29838d4feb1 with scrape type 2
2026-03-28 11:09:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebaa4533-b143-5fda-bf73-c29838d4feb1, identifier: MX79326
2026-03-28 11:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:09:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326
2026-03-28 11:09:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326
2026-03-28 11:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebaa4533-b143-5fda-bf73-c29838d4feb1 with identifier: MX79326 to the API
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-28T16:16:52Z',
 'fuel_type': 'petrol',
 'id': 'ebaa4533-b143-5fda-bf73-c29838d4feb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX79326',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 127027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-14',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Confort',
 'transmission': 'manual',
 'trim': 'Confort',
 'year': 2008}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.de] INFO: Saving data for MX79326: {'auction_closing_time': 1774714612.0, 'created_time': 1774290986.750902, 'last_price_update_time': 1774696193.269873}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX79326') HTTP/1.1" 204 0
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: LG78390
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.de] INFO: Scrape type for XT91998: 2
2026-03-28 11:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998
2026-03-28 11:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106, identifier: XT91998
2026-03-28 11:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998
2026-03-28 11:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998
2026-03-28 11:09:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b6ff8f5-36d4-5d7c-b547-c6d0355e5106 with identifier: XT91998 to the API
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:33Z',
 'fuel_type': 'petrol',
 'id': '7b6ff8f5-36d4-5d7c-b547-c6d0355e5106',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT91998',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 43450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2018}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.de] INFO: Saving data for XT91998: {'auction_closing_time': 1774716693.0, 'created_time': 1773381016.251702, 'last_price_update_time': 1774696193.80281}
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT91998') HTTP/1.1" 204 0
2026-03-28 11:09:53 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-28 11:09:53 [auto1.de] INFO: Scrape type for PL64975: 2
2026-03-28 11:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975
2026-03-28 11:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d678ceb2-4da1-5e44-849d-a154c1377168 with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d678ceb2-4da1-5e44-849d-a154c1377168 with scrape type 2
2026-03-28 11:09:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d678ceb2-4da1-5e44-849d-a154c1377168, identifier: PL64975
2026-03-28 11:09:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975
2026-03-28 11:09:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975
2026-03-28 11:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d678ceb2-4da1-5e44-849d-a154c1377168 with identifier: PL64975 to the API
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:42:48Z',
 'fuel_type': 'hybrid',
 'id': 'd678ceb2-4da1-5e44-849d-a154c1377168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL64975',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 112537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-10',
 'seller_name': None,
 'title': 'Toyota Prius 1.5',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.de] INFO: Saving data for PL64975: {'auction_closing_time': 1774716168.0, 'created_time': 1774291369.830317, 'last_price_update_time': 1774696194.222508}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL64975') HTTP/1.1" 204 0
2026-03-28 11:09:54 [auto1.de] INFO: Channel: 24h | Page: 214 | totalHits: 9707 | hits on page: 40
2026-03-28 11:09:54 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-28 11:09:54 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-28 11:09:54 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.de] INFO: Scrape type for GK82878: 2
2026-03-28 11:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878
2026-03-28 11:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f, identifier: GK82878
2026-03-28 11:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878
2026-03-28 11:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878
2026-03-28 11:09:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04ed7688-e5aa-58a2-a68a-12a6a4cd819f with identifier: GK82878 to the API
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:10Z',
 'fuel_type': 'petrol',
 'id': '04ed7688-e5aa-58a2-a68a-12a6a4cd819f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK82878',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 122549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-19',
 'seller_name': None,
 'title': 'Mazda 6 1.8 Active Sport',
 'transmission': 'manual',
 'trim': 'Active Sport',
 'year': 2007}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.de] INFO: Saving data for GK82878: {'auction_closing_time': 1774713730.0, 'created_time': 1773345580.268085, 'last_price_update_time': 1774696194.66477}
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK82878') HTTP/1.1" 204 0
2026-03-28 11:09:54 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.de] INFO: Scrape type for NH13691: 2
2026-03-28 11:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691
2026-03-28 11:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9, identifier: NH13691
2026-03-28 11:09:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:54 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-28 11:09:54 [auto1.de] INFO: Scrape type for CG37659: 2
2026-03-28 11:09:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659
2026-03-28 11:09:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ded9a852-ba97-547d-8c7f-c0e9363d3a45 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ded9a852-ba97-547d-8c7f-c0e9363d3a45 with scrape type 2
2026-03-28 11:09:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ded9a852-ba97-547d-8c7f-c0e9363d3a45, identifier: CG37659
2026-03-28 11:09:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691
2026-03-28 11:09:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691
2026-03-28 11:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34f648d1-f500-5c5b-8807-9ea32ce3ffd9 with identifier: NH13691 to the API
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:41:23Z',
 'fuel_type': 'petrol',
 'id': '34f648d1-f500-5c5b-8807-9ea32ce3ffd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH13691',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 105251,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.de] INFO: Saving data for NH13691: {'auction_closing_time': 1774716083.0, 'created_time': 1773830144.010198, 'last_price_update_time': 1774696195.204653}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH13691') HTTP/1.1" 204 0
2026-03-28 11:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659
2026-03-28 11:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659
2026-03-28 11:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ded9a852-ba97-547d-8c7f-c0e9363d3a45 with identifier: CG37659 to the API
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:41:25Z',
 'fuel_type': 'diesel',
 'id': 'ded9a852-ba97-547d-8c7f-c0e9363d3a45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG37659',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 127702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.de] INFO: Saving data for CG37659: {'auction_closing_time': 1774716085.0, 'created_time': 1773380140.319742, 'last_price_update_time': 1774696195.551433}
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG37659') HTTP/1.1" 204 0
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.de] INFO: Scrape type for HX18202: 2
2026-03-28 11:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202
2026-03-28 11:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327, identifier: HX18202
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-28 11:09:55 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [auto1.de] INFO: Scrape type for GV33356: 2
2026-03-28 11:09:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356
2026-03-28 11:09:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 141b9907-123c-5e4e-aa39-3105849030d0 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 141b9907-123c-5e4e-aa39-3105849030d0 with scrape type 2
2026-03-28 11:09:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 141b9907-123c-5e4e-aa39-3105849030d0, identifier: GV33356
2026-03-28 11:09:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202
2026-03-28 11:09:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202
2026-03-28 11:09:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327 with identifier: HX18202 to the API
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:46Z',
 'fuel_type': 'petrol',
 'id': '89bbaa72-5c3b-5d4a-bcaf-2c1e621e7327',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX18202',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 109637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-03',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2017}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.de] INFO: Saving data for HX18202: {'auction_closing_time': 1774714066.0, 'created_time': 1774290982.724862, 'last_price_update_time': 1774696196.123921}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX18202') HTTP/1.1" 204 0
2026-03-28 11:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356
2026-03-28 11:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356
2026-03-28 11:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 141b9907-123c-5e4e-aa39-3105849030d0 with identifier: GV33356 to the API
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:08:50Z',
 'fuel_type': 'petrol',
 'id': '141b9907-123c-5e4e-aa39-3105849030d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV33356',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 189332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-30',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.de] INFO: Saving data for GV33356: {'auction_closing_time': 1774714130.0, 'created_time': 1773304581.608919, 'last_price_update_time': 1774696196.554859}
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV33356') HTTP/1.1" 204 0
2026-03-28 11:09:56 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-28 11:09:56 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-28 11:09:56 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.de] INFO: Scrape type for KP72429: 2
2026-03-28 11:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429
2026-03-28 11:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6, identifier: KP72429
2026-03-28 11:09:56 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [auto1.de] INFO: Scrape type for EY45109: 2
2026-03-28 11:09:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109
2026-03-28 11:09:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91feca9-5fc7-57b4-aa02-9fa16808159e with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e91feca9-5fc7-57b4-aa02-9fa16808159e with scrape type 2
2026-03-28 11:09:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e91feca9-5fc7-57b4-aa02-9fa16808159e, identifier: EY45109
2026-03-28 11:09:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429
2026-03-28 11:09:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429
2026-03-28 11:09:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34befb9a-7dd6-5454-b9b1-c05fb88e5ab6 with identifier: KP72429 to the API
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:33:22Z',
 'fuel_type': 'petrol',
 'id': '34befb9a-7dd6-5454-b9b1-c05fb88e5ab6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP72429',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 92911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2019}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.de] INFO: Saving data for KP72429: {'auction_closing_time': 1774715602.0, 'created_time': 1773383440.157252, 'last_price_update_time': 1774696197.167681}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP72429') HTTP/1.1" 204 0
2026-03-28 11:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109
2026-03-28 11:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109
2026-03-28 11:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e91feca9-5fc7-57b4-aa02-9fa16808159e with identifier: EY45109 to the API
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:57:47Z',
 'fuel_type': 'petrol',
 'id': 'e91feca9-5fc7-57b4-aa02-9fa16808159e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY45109',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 138328,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-21',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.de] INFO: Saving data for EY45109: {'auction_closing_time': 1774717067.0, 'created_time': 1773772543.133384, 'last_price_update_time': 1774696197.493056}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY45109') HTTP/1.1" 204 0
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.de] INFO: Scrape type for PH96915: 2
2026-03-28 11:09:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915
2026-03-28 11:09:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 545c7f75-9ff7-5f91-94be-70af58c45add with scrape type 2
2026-03-28 11:09:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 545c7f75-9ff7-5f91-94be-70af58c45add with scrape type 2
2026-03-28 11:09:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 545c7f75-9ff7-5f91-94be-70af58c45add, identifier: PH96915
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: ZV87570
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-28 11:09:57 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-28 11:09:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915
2026-03-28 11:09:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915
2026-03-28 11:09:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 545c7f75-9ff7-5f91-94be-70af58c45add with identifier: PH96915 to the API
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:43:27Z',
 'fuel_type': 'diesel',
 'id': '545c7f75-9ff7-5f91-94be-70af58c45add',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH96915',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 51274,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-28 11:09:57 [auto1.de] INFO: Saving data for PH96915: {'auction_closing_time': 1774716207.0, 'created_time': 1773775869.779726, 'last_price_update_time': 1774696197.901483}
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH96915') HTTP/1.1" 204 0
2026-03-28 11:09:58 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.de] INFO: Scrape type for WW12135: 2
2026-03-28 11:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135
2026-03-28 11:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed, identifier: WW12135
2026-03-28 11:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135
2026-03-28 11:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135
2026-03-28 11:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1706d7f4-4bbf-579d-92b5-87c72bdd2eed with identifier: WW12135 to the API
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:42:30Z',
 'fuel_type': 'petrol',
 'id': '1706d7f4-4bbf-579d-92b5-87c72bdd2eed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW12135',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 43320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-23',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Club BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Club BlueMotion Tech',
 'year': 2015}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.de] INFO: Saving data for WW12135: {'auction_closing_time': 1774716150.0, 'created_time': 1774251382.950715, 'last_price_update_time': 1774696198.442002}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW12135') HTTP/1.1" 204 0
2026-03-28 11:09:58 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.de] INFO: Scrape type for MZ98399: 2
2026-03-28 11:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399
2026-03-28 11:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d55f978b-941e-589d-a126-ef9779bc91b6 with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d55f978b-941e-589d-a126-ef9779bc91b6 with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d55f978b-941e-589d-a126-ef9779bc91b6, identifier: MZ98399
2026-03-28 11:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399
2026-03-28 11:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399
2026-03-28 11:09:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d55f978b-941e-589d-a126-ef9779bc91b6 with identifier: MZ98399 to the API
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:09Z',
 'fuel_type': 'diesel',
 'id': 'd55f978b-941e-589d-a126-ef9779bc91b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ98399',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 106846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-21',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.de] INFO: Saving data for MZ98399: {'auction_closing_time': 1774714029.0, 'created_time': 1773772625.722903, 'last_price_update_time': 1774696198.866499}
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ98399') HTTP/1.1" 204 0
2026-03-28 11:09:58 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-28 11:09:58 [auto1.de] INFO: Scrape type for LN73181: 2
2026-03-28 11:09:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181
2026-03-28 11:09:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf6b590-2465-5226-bcdb-a5e3f0b6181c with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf6b590-2465-5226-bcdb-a5e3f0b6181c with scrape type 2
2026-03-28 11:09:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf6b590-2465-5226-bcdb-a5e3f0b6181c, identifier: LN73181
2026-03-28 11:09:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181
2026-03-28 11:09:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181
2026-03-28 11:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf6b590-2465-5226-bcdb-a5e3f0b6181c with identifier: LN73181 to the API
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:15:32Z',
 'fuel_type': 'diesel',
 'id': 'faf6b590-2465-5226-bcdb-a5e3f0b6181c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN73181',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 168467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-09',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2013}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.de] INFO: Saving data for LN73181: {'auction_closing_time': 1774714532.0, 'created_time': 1773305947.44444, 'last_price_update_time': 1774696199.26746}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN73181') HTTP/1.1" 204 0
2026-03-28 11:09:59 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-28 11:09:59 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-28 11:09:59 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-28 11:09:59 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.de] INFO: Scrape type for UY19816: 2
2026-03-28 11:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816
2026-03-28 11:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf72fab7-c316-5479-aa5c-244c6e38af95 with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf72fab7-c316-5479-aa5c-244c6e38af95 with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf72fab7-c316-5479-aa5c-244c6e38af95, identifier: UY19816
2026-03-28 11:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816
2026-03-28 11:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816
2026-03-28 11:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf72fab7-c316-5479-aa5c-244c6e38af95 with identifier: UY19816 to the API
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:28:22Z',
 'fuel_type': 'hybrid',
 'id': 'bf72fab7-c316-5479-aa5c-244c6e38af95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY19816',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7',
 'odometer': 19391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-30',
 'seller_name': None,
 'title': 'DS Automobiles DS7 1.6 E-Tense Hybrid 4x2 Rivoli',
 'transmission': 'automatic',
 'trim': '4x2 Rivoli',
 'year': 2022}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.de] INFO: Saving data for UY19816: {'auction_closing_time': 1774715302.0, 'created_time': 1773775973.304739, 'last_price_update_time': 1774696199.687551}
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY19816') HTTP/1.1" 204 0
2026-03-28 11:09:59 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [auto1.de] INFO: Scrape type for EJ97789: 2
2026-03-28 11:09:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789
2026-03-28 11:09:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d212b88-77e7-51df-a6a5-ddfe5688546a with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d212b88-77e7-51df-a6a5-ddfe5688546a with scrape type 2
2026-03-28 11:09:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d212b88-77e7-51df-a6a5-ddfe5688546a, identifier: EJ97789
2026-03-28 11:09:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789
2026-03-28 11:09:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789
2026-03-28 11:09:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d212b88-77e7-51df-a6a5-ddfe5688546a with identifier: EJ97789 to the API
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:14:38Z',
 'fuel_type': 'diesel',
 'id': '8d212b88-77e7-51df-a6a5-ddfe5688546a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ97789',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 226588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Saving data for EJ97789: {'auction_closing_time': 1774714478.0, 'created_time': 1773381311.037357, 'last_price_update_time': 1774696200.12958}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ97789') HTTP/1.1" 204 0
2026-03-28 11:10:00 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-28 11:10:00 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Scrape type for GU30537: 2
2026-03-28 11:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537
2026-03-28 11:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77f20a95-fc35-532b-adcb-a222c15e6a67 with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77f20a95-fc35-532b-adcb-a222c15e6a67 with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77f20a95-fc35-532b-adcb-a222c15e6a67, identifier: GU30537
2026-03-28 11:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537
2026-03-28 11:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537
2026-03-28 11:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77f20a95-fc35-532b-adcb-a222c15e6a67 with identifier: GU30537 to the API
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:49:51Z',
 'fuel_type': 'petrol',
 'id': '77f20a95-fc35-532b-adcb-a222c15e6a67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU30537',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 162304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-18',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Saving data for GU30537: {'auction_closing_time': 1774716591.0, 'created_time': 1773134912.862582, 'last_price_update_time': 1774696200.558624}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU30537') HTTP/1.1" 204 0
2026-03-28 11:10:00 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-28 11:10:00 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-28 11:10:00 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-28 11:10:00 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Scrape type for LS10539: 2
2026-03-28 11:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539
2026-03-28 11:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd95f7bb-756c-55be-993f-8699e40389ea with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd95f7bb-756c-55be-993f-8699e40389ea with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd95f7bb-756c-55be-993f-8699e40389ea, identifier: LS10539
2026-03-28 11:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539
2026-03-28 11:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539
2026-03-28 11:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd95f7bb-756c-55be-993f-8699e40389ea with identifier: LS10539 to the API
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:28:25Z',
 'fuel_type': 'diesel',
 'id': 'bd95f7bb-756c-55be-993f-8699e40389ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS10539',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 228824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-30',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.9 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [auto1.de] INFO: Saving data for LS10539: {'auction_closing_time': 1774715305.0, 'created_time': 1773686158.237784, 'last_price_update_time': 1774696200.998912}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS10539') HTTP/1.1" 204 0
2026-03-28 11:10:01 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-28 11:10:01 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.de] INFO: Scrape type for LB66833: 2
2026-03-28 11:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833
2026-03-28 11:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a6be496-8bbe-51da-98a3-28cae4b041ab with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a6be496-8bbe-51da-98a3-28cae4b041ab with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a6be496-8bbe-51da-98a3-28cae4b041ab, identifier: LB66833
2026-03-28 11:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833
2026-03-28 11:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833
2026-03-28 11:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a6be496-8bbe-51da-98a3-28cae4b041ab with identifier: LB66833 to the API
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:54:20Z',
 'fuel_type': 'petrol',
 'id': '8a6be496-8bbe-51da-98a3-28cae4b041ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB66833',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 37838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-13',
 'seller_name': None,
 'title': 'Renault Captur 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2020}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.de] INFO: Saving data for LB66833: {'auction_closing_time': 1774716860.0, 'created_time': 1773772561.424565, 'last_price_update_time': 1774696201.637329}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB66833') HTTP/1.1" 204 0
2026-03-28 11:10:01 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [auto1.de] INFO: Scrape type for ZL98433: 2
2026-03-28 11:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433
2026-03-28 11:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe7c6c83-8cea-5593-9025-a8b9a3523c06 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe7c6c83-8cea-5593-9025-a8b9a3523c06 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe7c6c83-8cea-5593-9025-a8b9a3523c06, identifier: ZL98433
2026-03-28 11:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433
2026-03-28 11:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433
2026-03-28 11:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe7c6c83-8cea-5593-9025-a8b9a3523c06 with identifier: ZL98433 to the API
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:05:53Z',
 'fuel_type': 'petrol',
 'id': 'fe7c6c83-8cea-5593-9025-a8b9a3523c06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL98433',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 25456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TSI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2023}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Saving data for ZL98433: {'auction_closing_time': 1774713953.0, 'created_time': 1774291354.381908, 'last_price_update_time': 1774696202.124237}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL98433') HTTP/1.1" 204 0
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Scrape type for SL44411: 2
2026-03-28 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411
2026-03-28 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d1df71-673f-532d-90c4-f7829d23ae38 with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d1df71-673f-532d-90c4-f7829d23ae38 with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34d1df71-673f-532d-90c4-f7829d23ae38, identifier: SL44411
2026-03-28 11:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411
2026-03-28 11:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411
2026-03-28 11:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34d1df71-673f-532d-90c4-f7829d23ae38 with identifier: SL44411 to the API
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:52:44Z',
 'fuel_type': 'petrol',
 'id': '34d1df71-673f-532d-90c4-f7829d23ae38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL44411',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 234069,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Saving data for SL44411: {'auction_closing_time': 1774716764.0, 'created_time': 1773381763.482062, 'last_price_update_time': 1774696202.583068}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL44411') HTTP/1.1" 204 0
2026-03-28 11:10:02 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [auto1.de] INFO: Scrape type for PD01129: 2
2026-03-28 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129
2026-03-28 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 364104c5-2621-520a-b0b0-e2269758fae5 with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 364104c5-2621-520a-b0b0-e2269758fae5 with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 364104c5-2621-520a-b0b0-e2269758fae5, identifier: PD01129
2026-03-28 11:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129
2026-03-28 11:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129
2026-03-28 11:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 364104c5-2621-520a-b0b0-e2269758fae5 with identifier: PD01129 to the API
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:12:05Z',
 'fuel_type': 'diesel',
 'id': '364104c5-2621-520a-b0b0-e2269758fae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD01129',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 215400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-04',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Ambition',
 'transmission': 'automatic',
 'trim': 'quattro Ambition',
 'year': 2015}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.de] INFO: Saving data for PD01129: {'auction_closing_time': 1774714325.0, 'created_time': 1774293468.080514, 'last_price_update_time': 1774696203.04097}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD01129') HTTP/1.1" 204 0
2026-03-28 11:10:03 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.de] INFO: Scrape type for RE17291: 2
2026-03-28 11:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291
2026-03-28 11:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d325fbd-37b0-5063-80f7-7e252e004c80 with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d325fbd-37b0-5063-80f7-7e252e004c80 with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d325fbd-37b0-5063-80f7-7e252e004c80, identifier: RE17291
2026-03-28 11:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291
2026-03-28 11:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291
2026-03-28 11:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d325fbd-37b0-5063-80f7-7e252e004c80 with identifier: RE17291 to the API
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:02:08Z',
 'fuel_type': 'petrol',
 'id': '9d325fbd-37b0-5063-80f7-7e252e004c80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE17291',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 177698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.de] INFO: Saving data for RE17291: {'auction_closing_time': 1774713728.0, 'created_time': 1773773948.019418, 'last_price_update_time': 1774696203.489937}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE17291') HTTP/1.1" 204 0
2026-03-28 11:10:03 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-28 11:10:03 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-28 11:10:03 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-28 11:10:03 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-28 11:10:03 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-28 11:10:03 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-28 11:10:03 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [auto1.de] INFO: Scrape type for HL98851: 2
2026-03-28 11:10:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851
2026-03-28 11:10:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6323b91-00df-5647-b5e8-8623102b58c4 with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6323b91-00df-5647-b5e8-8623102b58c4 with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6323b91-00df-5647-b5e8-8623102b58c4, identifier: HL98851
2026-03-28 11:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851
2026-03-28 11:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851
2026-03-28 11:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6323b91-00df-5647-b5e8-8623102b58c4 with identifier: HL98851 to the API
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:10:31Z',
 'fuel_type': 'petrol',
 'id': 'a6323b91-00df-5647-b5e8-8623102b58c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL98851',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 102031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 Delsey 4x4',
 'transmission': 'manual',
 'trim': 'Delsey 4x4',
 'year': 2012}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.de] INFO: Saving data for HL98851: {'auction_closing_time': 1774714231.0, 'created_time': 1774293107.489128, 'last_price_update_time': 1774696204.028511}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL98851') HTTP/1.1" 204 0
2026-03-28 11:10:04 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-28 11:10:04 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.de] INFO: Scrape type for VV03695: 2
2026-03-28 11:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695
2026-03-28 11:10:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764d0d0e-80d8-5831-b147-5d81d0335d48 with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 764d0d0e-80d8-5831-b147-5d81d0335d48 with scrape type 2
2026-03-28 11:10:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 764d0d0e-80d8-5831-b147-5d81d0335d48, identifier: VV03695
2026-03-28 11:10:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695
2026-03-28 11:10:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695
2026-03-28 11:10:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 764d0d0e-80d8-5831-b147-5d81d0335d48 with identifier: VV03695 to the API
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:21:07Z',
 'fuel_type': 'petrol',
 'id': '764d0d0e-80d8-5831-b147-5d81d0335d48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV03695',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 116170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-15',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [auto1.de] INFO: Saving data for VV03695: {'auction_closing_time': 1774714867.0, 'created_time': 1773831719.042165, 'last_price_update_time': 1774696204.693545}
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV03695') HTTP/1.1" 204 0
2026-03-28 11:10:06 [scrapy.extensions.logstats] INFO: Crawled 430 pages (at 5 pages/min), scraped 586 items (at 96 items/min)
2026-03-28 11:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:10:13 [auto1.de] INFO: Channel: 24h | Page: 215 | totalHits: 9708 | hits on page: 40
2026-03-28 11:10:13 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [auto1.de] INFO: Scrape type for VV03695: 0
2026-03-28 11:10:13 [auto1.de] INFO: Found listing with ID: FP37093
2026-03-28 11:10:13 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-28 11:10:13 [auto1.de] INFO: Found listing with ID: RZ61544
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ61544%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [auto1.de] INFO: Scrape type for RZ61544: 2
2026-03-28 11:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e2398aa-6391-5d9a-8764-60c8a064515d with identifier: RZ61544
2026-03-28 11:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e2398aa-6391-5d9a-8764-60c8a064515d with scrape type 2
2026-03-28 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e2398aa-6391-5d9a-8764-60c8a064515d with scrape type 2
2026-03-28 11:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e2398aa-6391-5d9a-8764-60c8a064515d, identifier: RZ61544
2026-03-28 11:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e2398aa-6391-5d9a-8764-60c8a064515d with identifier: RZ61544
2026-03-28 11:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e2398aa-6391-5d9a-8764-60c8a064515d with identifier: RZ61544
2026-03-28 11:10:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e2398aa-6391-5d9a-8764-60c8a064515d with identifier: RZ61544 to the API
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:32:36Z',
 'fuel_type': 'petrol',
 'id': '6e2398aa-6391-5d9a-8764-60c8a064515d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ61544',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 146949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-09',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2009}
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ61544%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [auto1.de] INFO: Saving data for RZ61544: {'auction_closing_time': 1774715556.0, 'created_time': 1774608199.150279, 'last_price_update_time': 1774696214.25982}
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ61544') HTTP/1.1" 204 0
2026-03-28 11:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:14 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [auto1.de] INFO: Scrape type for CD36219: 2
2026-03-28 11:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219
2026-03-28 11:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with scrape type 2
2026-03-28 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with scrape type 2
2026-03-28 11:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47a2dfd1-58f1-5510-aa50-f467d04c87c5, identifier: CD36219
2026-03-28 11:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219
2026-03-28 11:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219
2026-03-28 11:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47a2dfd1-58f1-5510-aa50-f467d04c87c5 with identifier: CD36219 to the API
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:21:11Z',
 'fuel_type': 'petrol',
 'id': '47a2dfd1-58f1-5510-aa50-f467d04c87c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD36219',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 112948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2011}
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [auto1.de] INFO: Saving data for CD36219: {'auction_closing_time': 1774714871.0, 'created_time': 1773382997.07571, 'last_price_update_time': 1774696214.779551}
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD36219') HTTP/1.1" 204 0
2026-03-28 11:10:14 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [auto1.de] INFO: Scrape type for SL28048: 2
2026-03-28 11:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048
2026-03-28 11:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb42f229-94a6-52e3-89d6-8ba9c7b2164a with scrape type 2
2026-03-28 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb42f229-94a6-52e3-89d6-8ba9c7b2164a with scrape type 2
2026-03-28 11:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb42f229-94a6-52e3-89d6-8ba9c7b2164a, identifier: SL28048
2026-03-28 11:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048
2026-03-28 11:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048
2026-03-28 11:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb42f229-94a6-52e3-89d6-8ba9c7b2164a with identifier: SL28048 to the API
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:44:17Z',
 'fuel_type': 'petrol',
 'id': 'eb42f229-94a6-52e3-89d6-8ba9c7b2164a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL28048',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 122257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-07',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-28 11:10:15 [auto1.de] INFO: Saving data for SL28048: {'auction_closing_time': 1774716257.0, 'created_time': 1773399707.236227, 'last_price_update_time': 1774696215.231869}
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL28048') HTTP/1.1" 204 0
2026-03-28 11:10:15 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-28 11:10:15 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-28 11:10:15 [auto1.de] INFO: Scrape type for FG21922: 2
2026-03-28 11:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922
2026-03-28 11:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a19041cf-b367-503c-a784-1156b1400523 with scrape type 2
2026-03-28 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a19041cf-b367-503c-a784-1156b1400523 with scrape type 2
2026-03-28 11:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a19041cf-b367-503c-a784-1156b1400523, identifier: FG21922
2026-03-28 11:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922
2026-03-28 11:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922
2026-03-28 11:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a19041cf-b367-503c-a784-1156b1400523 with identifier: FG21922 to the API
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-28T16:56:59Z',
 'fuel_type': 'petrol',
 'id': 'a19041cf-b367-503c-a784-1156b1400523',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG21922',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 163277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 500 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-28 11:10:15 [auto1.de] INFO: Saving data for FG21922: {'auction_closing_time': 1774717019.0, 'created_time': 1773428276.187695, 'last_price_update_time': 1774696215.68103}
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG21922') HTTP/1.1" 204 0
2026-03-28 11:10:15 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-28 11:10:15 [auto1.de] INFO: Scrape type for BV10728: 2
2026-03-28 11:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728
2026-03-28 11:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba53aa0c-91b5-55de-8110-22e30ff94ffb with scrape type 2
2026-03-28 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba53aa0c-91b5-55de-8110-22e30ff94ffb with scrape type 2
2026-03-28 11:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba53aa0c-91b5-55de-8110-22e30ff94ffb, identifier: BV10728
2026-03-28 11:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728
2026-03-28 11:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728
2026-03-28 11:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba53aa0c-91b5-55de-8110-22e30ff94ffb with identifier: BV10728 to the API
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:41:19Z',
 'fuel_type': 'diesel',
 'id': 'ba53aa0c-91b5-55de-8110-22e30ff94ffb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV10728',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 180868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-12',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [auto1.de] INFO: Saving data for BV10728: {'auction_closing_time': 1774716079.0, 'created_time': 1774608138.995601, 'last_price_update_time': 1774696216.119441}
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV10728') HTTP/1.1" 204 0
2026-03-28 11:10:16 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-28 11:10:16 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [auto1.de] INFO: Scrape type for YV93929: 2
2026-03-28 11:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929
2026-03-28 11:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with scrape type 2
2026-03-28 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with scrape type 2
2026-03-28 11:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf83a435-efcc-5fd5-931b-6b7d552a6ed3, identifier: YV93929
2026-03-28 11:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929
2026-03-28 11:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929
2026-03-28 11:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf83a435-efcc-5fd5-931b-6b7d552a6ed3 with identifier: YV93929 to the API
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:02:00Z',
 'fuel_type': 'petrol',
 'id': 'cf83a435-efcc-5fd5-931b-6b7d552a6ed3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV93929',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 106494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-10',
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2019}
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [auto1.de] INFO: Saving data for YV93929: {'auction_closing_time': 1774713720.0, 'created_time': 1773772703.753748, 'last_price_update_time': 1774696216.646565}
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV93929') HTTP/1.1" 204 0
2026-03-28 11:10:16 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [auto1.de] INFO: Scrape type for AJ83009: 2
2026-03-28 11:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009
2026-03-28 11:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with scrape type 2
2026-03-28 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with scrape type 2
2026-03-28 11:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9, identifier: AJ83009
2026-03-28 11:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009
2026-03-28 11:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009
2026-03-28 11:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9 with identifier: AJ83009 to the API
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:05:47Z',
 'fuel_type': 'petrol',
 'id': '86c8ae81-6ef3-5ac5-9bd6-ab3d9b80c3c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ83009',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 99995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Fun',
 'transmission': 'manual',
 'trim': 'Fun',
 'year': 2006}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [auto1.de] INFO: Saving data for AJ83009: {'auction_closing_time': 1774713947.0, 'created_time': 1774608175.05267, 'last_price_update_time': 1774696217.031909}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ83009') HTTP/1.1" 204 0
2026-03-28 11:10:17 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [auto1.de] INFO: Scrape type for EX93586: 2
2026-03-28 11:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586
2026-03-28 11:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af135d60-e418-55af-b1fa-1f4cb862f2d9 with scrape type 2
2026-03-28 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af135d60-e418-55af-b1fa-1f4cb862f2d9 with scrape type 2
2026-03-28 11:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af135d60-e418-55af-b1fa-1f4cb862f2d9, identifier: EX93586
2026-03-28 11:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586
2026-03-28 11:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586
2026-03-28 11:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af135d60-e418-55af-b1fa-1f4cb862f2d9 with identifier: EX93586 to the API
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:22:08Z',
 'fuel_type': 'petrol',
 'id': 'af135d60-e418-55af-b1fa-1f4cb862f2d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX93586',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 85561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Turbo HSE Dynamic',
 'transmission': 'automatic',
 'trim': 'HSE Dynamic',
 'year': 2018}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [auto1.de] INFO: Saving data for EX93586: {'auction_closing_time': 1774714928.0, 'created_time': 1773383145.111176, 'last_price_update_time': 1774696217.447693}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX93586') HTTP/1.1" 204 0
2026-03-28 11:10:17 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [auto1.de] INFO: Scrape type for JU52980: 2
2026-03-28 11:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980
2026-03-28 11:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with scrape type 2
2026-03-28 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with scrape type 2
2026-03-28 11:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948, identifier: JU52980
2026-03-28 11:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980
2026-03-28 11:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980
2026-03-28 11:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 950bb0b9-ec6f-505c-9aa3-10fe8a8fa948 with identifier: JU52980 to the API
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:26:49Z',
 'fuel_type': 'diesel',
 'id': '950bb0b9-ec6f-505c-9aa3-10fe8a8fa948',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU52980',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 24373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-15',
 'seller_name': None,
 'title': 'Fiat Fiorino 1.3 M-Jet SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2022}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [auto1.de] INFO: Saving data for JU52980: {'auction_closing_time': 1774715209.0, 'created_time': 1773303993.65365, 'last_price_update_time': 1774696217.87157}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU52980') HTTP/1.1" 204 0
2026-03-28 11:10:17 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-28 11:10:17 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-28 11:10:17 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-28 11:10:17 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-28 11:10:17 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [auto1.de] INFO: Scrape type for JB35967: 2
2026-03-28 11:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967
2026-03-28 11:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with scrape type 2
2026-03-28 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with scrape type 2
2026-03-28 11:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53, identifier: JB35967
2026-03-28 11:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967
2026-03-28 11:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967
2026-03-28 11:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53 with identifier: JB35967 to the API
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:58Z',
 'fuel_type': 'diesel',
 'id': '9bc658ec-9de8-56ed-8eaa-8d1d85d8fb53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB35967',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 102835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-15',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TDI Design BlueMotion',
 'transmission': 'manual',
 'trim': 'Design BlueMotion',
 'year': 2018}
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [auto1.de] INFO: Saving data for JB35967: {'auction_closing_time': 1774717018.0, 'created_time': 1773427072.237348, 'last_price_update_time': 1774696218.314138}
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB35967') HTTP/1.1" 204 0
2026-03-28 11:10:18 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [auto1.de] INFO: Scrape type for BP45840: 2
2026-03-28 11:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840
2026-03-28 11:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cac7daf9-4f1f-581d-9946-7adb467dc4e5 with scrape type 2
2026-03-28 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cac7daf9-4f1f-581d-9946-7adb467dc4e5 with scrape type 2
2026-03-28 11:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cac7daf9-4f1f-581d-9946-7adb467dc4e5, identifier: BP45840
2026-03-28 11:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840
2026-03-28 11:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840
2026-03-28 11:10:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cac7daf9-4f1f-581d-9946-7adb467dc4e5 with identifier: BP45840 to the API
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:59:41Z',
 'fuel_type': 'petrol',
 'id': 'cac7daf9-4f1f-581d-9946-7adb467dc4e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP45840',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 161583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [auto1.de] INFO: Saving data for BP45840: {'auction_closing_time': 1774717181.0, 'created_time': 1773304994.395862, 'last_price_update_time': 1774696218.741266}
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP45840') HTTP/1.1" 204 0
2026-03-28 11:10:18 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [auto1.de] INFO: Scrape type for HB08106: 2
2026-03-28 11:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106
2026-03-28 11:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with scrape type 2
2026-03-28 11:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with scrape type 2
2026-03-28 11:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704, identifier: HB08106
2026-03-28 11:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106
2026-03-28 11:10:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106
2026-03-28 11:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704 with identifier: HB08106 to the API
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:39:39Z',
 'fuel_type': 'petrol',
 'id': '5cd7ed2c-7c5a-5561-9a62-7e3d3f81c704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB08106',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-15',
 'seller_name': None,
 'title': 'BMW 1er 128ti',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [auto1.de] INFO: Saving data for HB08106: {'auction_closing_time': 1774715979.0, 'created_time': 1774291074.517515, 'last_price_update_time': 1774696219.477542}
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB08106') HTTP/1.1" 204 0
2026-03-28 11:10:19 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-28 11:10:19 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-28 11:10:19 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-28 11:10:19 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [auto1.de] INFO: Scrape type for EP39271: 2
2026-03-28 11:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271
2026-03-28 11:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f25a1eae-a566-552b-9c2b-1e095580e88b with scrape type 2
2026-03-28 11:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f25a1eae-a566-552b-9c2b-1e095580e88b with scrape type 2
2026-03-28 11:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f25a1eae-a566-552b-9c2b-1e095580e88b, identifier: EP39271
2026-03-28 11:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271
2026-03-28 11:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271
2026-03-28 11:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f25a1eae-a566-552b-9c2b-1e095580e88b with identifier: EP39271 to the API
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 260,
 'expiration_date': '2026-03-28T16:03:02Z',
 'fuel_type': 'petrol',
 'id': 'f25a1eae-a566-552b-9c2b-1e095580e88b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP39271',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Nitro',
 'odometer': 60711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'Dodge Nitro 4.0 V6 R/T',
 'transmission': 'automatic',
 'trim': 'R/T',
 'year': 2017}
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [auto1.de] INFO: Saving data for EP39271: {'auction_closing_time': 1774713782.0, 'created_time': 1774263221.629681, 'last_price_update_time': 1774696219.969758}
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP39271') HTTP/1.1" 204 0
2026-03-28 11:10:20 [auto1.de] INFO: Channel: 24h | Page: 216 | totalHits: 9708 | hits on page: 40
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-28 11:10:20 [auto1.de] INFO: Scrape type for KU58060: 2
2026-03-28 11:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060
2026-03-28 11:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbfca0e1-a683-53be-bb8a-c3faa05ff005 with scrape type 2
2026-03-28 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbfca0e1-a683-53be-bb8a-c3faa05ff005 with scrape type 2
2026-03-28 11:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbfca0e1-a683-53be-bb8a-c3faa05ff005, identifier: KU58060
2026-03-28 11:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060
2026-03-28 11:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060
2026-03-28 11:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbfca0e1-a683-53be-bb8a-c3faa05ff005 with identifier: KU58060 to the API
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:53:17Z',
 'fuel_type': 'petrol',
 'id': 'fbfca0e1-a683-53be-bb8a-c3faa05ff005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU58060',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 38446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-22',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 TSI Edition 20 4Motion',
 'transmission': 'automatic',
 'trim': 'Edition 20 4Motion',
 'year': 2022}
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-28 11:10:20 [auto1.de] INFO: Saving data for KU58060: {'auction_closing_time': 1774716797.0, 'created_time': 1773773986.817217, 'last_price_update_time': 1774696220.4991}
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU58060') HTTP/1.1" 204 0
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-28 11:10:20 [auto1.de] INFO: Scrape type for DF45808: 2
2026-03-28 11:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808
2026-03-28 11:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with scrape type 2
2026-03-28 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with scrape type 2
2026-03-28 11:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f, identifier: DF45808
2026-03-28 11:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-28 11:10:20 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-28 11:10:20 [auto1.de] INFO: Scrape type for WV16405: 2
2026-03-28 11:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405
2026-03-28 11:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9ea9934-f283-5868-8c91-7b56cdd1fd6a with scrape type 2
2026-03-28 11:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9ea9934-f283-5868-8c91-7b56cdd1fd6a with scrape type 2
2026-03-28 11:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9ea9934-f283-5868-8c91-7b56cdd1fd6a, identifier: WV16405
2026-03-28 11:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808
2026-03-28 11:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808
2026-03-28 11:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875dfa3d-a4a6-527f-be7f-46ae90a5ed3f with identifier: DF45808 to the API
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'diesel',
 'id': '875dfa3d-a4a6-527f-be7f-46ae90a5ed3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF45808',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 272344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-06',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI R-Line Edition',
 'transmission': 'automatic',
 'trim': 'R-Line Edition',
 'year': 2009}
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-28 11:10:21 [auto1.de] INFO: Saving data for DF45808: {'auction_closing_time': 1774716565.0, 'created_time': 1773401295.068261, 'last_price_update_time': 1774696221.114549}
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF45808') HTTP/1.1" 204 0
2026-03-28 11:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405
2026-03-28 11:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405
2026-03-28 11:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9ea9934-f283-5868-8c91-7b56cdd1fd6a with identifier: WV16405 to the API
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:24:35Z',
 'fuel_type': 'diesel',
 'id': 'a9ea9934-f283-5868-8c91-7b56cdd1fd6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV16405',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 128224,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-11',
 'seller_name': None,
 'title': 'BMW 3er 320d Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2019}
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-28 11:10:21 [auto1.de] INFO: Saving data for WV16405: {'auction_closing_time': 1774715075.0, 'created_time': 1773859008.536862, 'last_price_update_time': 1774696221.652223}
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV16405') HTTP/1.1" 204 0
2026-03-28 11:10:21 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-28 11:10:21 [auto1.de] INFO: Found listing with ID: CH61883
2026-03-28 11:10:21 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-28 11:10:21 [auto1.de] INFO: Scrape type for SA68147: 2
2026-03-28 11:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147
2026-03-28 11:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with scrape type 2
2026-03-28 11:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with scrape type 2
2026-03-28 11:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0, identifier: SA68147
2026-03-28 11:10:21 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-28 11:10:21 [auto1.de] INFO: Scrape type for VE65204: 2
2026-03-28 11:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204
2026-03-28 11:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with scrape type 2
2026-03-28 11:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with scrape type 2
2026-03-28 11:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae377aab-f6b2-5016-a441-7a4a9e9d7d37, identifier: VE65204
2026-03-28 11:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147
2026-03-28 11:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147
2026-03-28 11:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0 with identifier: SA68147 to the API
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:24:27Z',
 'fuel_type': 'diesel',
 'id': '2a0ff73a-c3ef-5c73-a50b-f83005bbe9c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA68147',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 167646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'BMW 2er 214d Active Tourer Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-28 11:10:22 [auto1.de] INFO: Saving data for SA68147: {'auction_closing_time': 1774715067.0, 'created_time': 1773224388.456892, 'last_price_update_time': 1774696222.316194}
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA68147') HTTP/1.1" 204 0
2026-03-28 11:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204
2026-03-28 11:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204
2026-03-28 11:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae377aab-f6b2-5016-a441-7a4a9e9d7d37 with identifier: VE65204 to the API
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:20Z',
 'fuel_type': 'diesel',
 'id': 'ae377aab-f6b2-5016-a441-7a4a9e9d7d37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE65204',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 134735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-28 11:10:22 [auto1.de] INFO: Saving data for VE65204: {'auction_closing_time': 1774716320.0, 'created_time': 1774263232.331561, 'last_price_update_time': 1774696222.737652}
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE65204') HTTP/1.1" 204 0
2026-03-28 11:10:22 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-28 11:10:22 [auto1.de] INFO: Scrape type for DK64287: 2
2026-03-28 11:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287
2026-03-28 11:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with scrape type 2
2026-03-28 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with scrape type 2
2026-03-28 11:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d0ae62d-2e3f-5e99-891c-05aaaed55274, identifier: DK64287
2026-03-28 11:10:22 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-28 11:10:22 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-28 11:10:22 [auto1.de] INFO: Scrape type for VJ38627: 2
2026-03-28 11:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627
2026-03-28 11:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with scrape type 2
2026-03-28 11:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with scrape type 2
2026-03-28 11:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a, identifier: VJ38627
2026-03-28 11:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287
2026-03-28 11:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287
2026-03-28 11:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d0ae62d-2e3f-5e99-891c-05aaaed55274 with identifier: DK64287 to the API
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:09Z',
 'fuel_type': 'diesel',
 'id': '9d0ae62d-2e3f-5e99-891c-05aaaed55274',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK64287',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 155870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2017}
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-28 11:10:23 [auto1.de] INFO: Saving data for DK64287: {'auction_closing_time': 1774715649.0, 'created_time': 1773775604.571182, 'last_price_update_time': 1774696223.333789}
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK64287') HTTP/1.1" 204 0
2026-03-28 11:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627
2026-03-28 11:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627
2026-03-28 11:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a with identifier: VJ38627 to the API
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:54:42Z',
 'fuel_type': 'hybrid',
 'id': '00802d6e-b2c2-5bec-8ee6-b6ac9ff1a70a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ38627',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 161252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-02',
 'seller_name': None,
 'title': 'Audi Q5 50 TFSIe quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-28 11:10:23 [auto1.de] INFO: Saving data for VJ38627: {'auction_closing_time': 1774716882.0, 'created_time': 1773772524.461254, 'last_price_update_time': 1774696223.63493}
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ38627') HTTP/1.1" 204 0
2026-03-28 11:10:23 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-28 11:10:23 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-28 11:10:23 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-28 11:10:23 [auto1.de] INFO: Scrape type for WD52714: 2
2026-03-28 11:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714
2026-03-28 11:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541348c9-84cf-5aab-b956-6ff98c877dbc with scrape type 2
2026-03-28 11:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541348c9-84cf-5aab-b956-6ff98c877dbc with scrape type 2
2026-03-28 11:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541348c9-84cf-5aab-b956-6ff98c877dbc, identifier: WD52714
2026-03-28 11:10:23 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-28 11:10:23 [auto1.de] INFO: Scrape type for YE66083: 2
2026-03-28 11:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083
2026-03-28 11:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87da8ecd-f582-5461-a39b-0520f7579417 with scrape type 2
2026-03-28 11:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87da8ecd-f582-5461-a39b-0520f7579417 with scrape type 2
2026-03-28 11:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87da8ecd-f582-5461-a39b-0520f7579417, identifier: YE66083
2026-03-28 11:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714
2026-03-28 11:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714
2026-03-28 11:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541348c9-84cf-5aab-b956-6ff98c877dbc with identifier: WD52714 to the API
2026-03-28 11:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:35:15Z',
 'fuel_type': 'petrol',
 'id': '541348c9-84cf-5aab-b956-6ff98c877dbc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD52714',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 115888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-20',
 'seller_name': None,
 'title': 'BMW X5 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-28 11:10:25 [auto1.de] INFO: Saving data for WD52714: {'auction_closing_time': 1774715715.0, 'created_time': 1774608156.661404, 'last_price_update_time': 1774696225.123147}
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD52714') HTTP/1.1" 204 0
2026-03-28 11:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083
2026-03-28 11:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083
2026-03-28 11:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87da8ecd-f582-5461-a39b-0520f7579417 with identifier: YE66083 to the API
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:26:36Z',
 'fuel_type': 'hybrid',
 'id': '87da8ecd-f582-5461-a39b-0520f7579417',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE66083',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 45331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2023}
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-28 11:10:25 [auto1.de] INFO: Saving data for YE66083: {'auction_closing_time': 1774715196.0, 'created_time': 1773775921.971273, 'last_price_update_time': 1774696225.519754}
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE66083') HTTP/1.1" 204 0
2026-03-28 11:10:25 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-28 11:10:25 [auto1.de] INFO: Scrape type for DY67323: 2
2026-03-28 11:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323
2026-03-28 11:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccfb5977-0cd9-5059-94f2-2521608a8435 with scrape type 2
2026-03-28 11:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccfb5977-0cd9-5059-94f2-2521608a8435 with scrape type 2
2026-03-28 11:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccfb5977-0cd9-5059-94f2-2521608a8435, identifier: DY67323
2026-03-28 11:10:25 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-28 11:10:25 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-28 11:10:25 [auto1.de] INFO: Scrape type for XR06088: 2
2026-03-28 11:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088
2026-03-28 11:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a950c4cb-e475-5f41-a41a-cfc268e8ce08 with scrape type 2
2026-03-28 11:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a950c4cb-e475-5f41-a41a-cfc268e8ce08 with scrape type 2
2026-03-28 11:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a950c4cb-e475-5f41-a41a-cfc268e8ce08, identifier: XR06088
2026-03-28 11:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323
2026-03-28 11:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323
2026-03-28 11:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccfb5977-0cd9-5059-94f2-2521608a8435 with identifier: DY67323 to the API
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:42:21Z',
 'fuel_type': 'hybrid',
 'id': 'ccfb5977-0cd9-5059-94f2-2521608a8435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY67323',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 57125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-28 11:10:26 [auto1.de] INFO: Saving data for DY67323: {'auction_closing_time': 1774716141.0, 'created_time': 1773133804.462022, 'last_price_update_time': 1774696226.085185}
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY67323') HTTP/1.1" 204 0
2026-03-28 11:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088
2026-03-28 11:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088
2026-03-28 11:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a950c4cb-e475-5f41-a41a-cfc268e8ce08 with identifier: XR06088 to the API
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:41:30Z',
 'fuel_type': 'electro',
 'id': 'a950c4cb-e475-5f41-a41a-cfc268e8ce08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR06088',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 93134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-20',
 'seller_name': None,
 'title': 'Volkswagen ID.4 electric drive 150 kW Family Pro Performance',
 'transmission': 'automatic',
 'trim': 'Family Pro Performance',
 'year': 2021}
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-28 11:10:26 [auto1.de] INFO: Saving data for XR06088: {'auction_closing_time': 1774716090.0, 'created_time': 1774330543.487411, 'last_price_update_time': 1774696226.431705}
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR06088') HTTP/1.1" 204 0
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: LK48428
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-28 11:10:26 [auto1.de] INFO: Scrape type for NF75522: 2
2026-03-28 11:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522
2026-03-28 11:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3238025c-6061-5233-9191-0baaae62f2c3 with scrape type 2
2026-03-28 11:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3238025c-6061-5233-9191-0baaae62f2c3 with scrape type 2
2026-03-28 11:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3238025c-6061-5233-9191-0baaae62f2c3, identifier: NF75522
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-28 11:10:26 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-28 11:10:26 [auto1.de] INFO: Scrape type for YD55328: 2
2026-03-28 11:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328
2026-03-28 11:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64981901-77f8-5c58-9f59-24ac9625466a with scrape type 2
2026-03-28 11:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64981901-77f8-5c58-9f59-24ac9625466a with scrape type 2
2026-03-28 11:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64981901-77f8-5c58-9f59-24ac9625466a, identifier: YD55328
2026-03-28 11:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522
2026-03-28 11:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522
2026-03-28 11:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3238025c-6061-5233-9191-0baaae62f2c3 with identifier: NF75522 to the API
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-28T16:12:49Z',
 'fuel_type': 'diesel',
 'id': '3238025c-6061-5233-9191-0baaae62f2c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF75522',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 72616,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-24',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-28 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-28 11:10:27 [auto1.de] INFO: Saving data for NF75522: {'auction_closing_time': 1774714369.0, 'created_time': 1774264606.462797, 'last_price_update_time': 1774696227.068271}
2026-03-28 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF75522') HTTP/1.1" 204 0
2026-03-28 11:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328
2026-03-28 11:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328
2026-03-28 11:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64981901-77f8-5c58-9f59-24ac9625466a with identifier: YD55328 to the API
2026-03-28 11:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:58:13Z',
 'fuel_type': 'diesel',
 'id': '64981901-77f8-5c58-9f59-24ac9625466a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD55328',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 84322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-02',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2019}
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-28 11:10:28 [auto1.de] INFO: Saving data for YD55328: {'auction_closing_time': 1774717093.0, 'created_time': 1773381308.776175, 'last_price_update_time': 1774696228.103474}
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD55328') HTTP/1.1" 204 0
2026-03-28 11:10:28 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-28 11:10:28 [auto1.de] INFO: Scrape type for EJ83325: 2
2026-03-28 11:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325
2026-03-28 11:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cad041a1-6711-5ad4-98a5-636fc7f72769 with scrape type 2
2026-03-28 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cad041a1-6711-5ad4-98a5-636fc7f72769 with scrape type 2
2026-03-28 11:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cad041a1-6711-5ad4-98a5-636fc7f72769, identifier: EJ83325
2026-03-28 11:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325
2026-03-28 11:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325
2026-03-28 11:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cad041a1-6711-5ad4-98a5-636fc7f72769 with identifier: EJ83325 to the API
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:22:29Z',
 'fuel_type': 'petrol',
 'id': 'cad041a1-6711-5ad4-98a5-636fc7f72769',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ83325',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 31095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-12',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-28 11:10:28 [auto1.de] INFO: Saving data for EJ83325: {'auction_closing_time': 1774714949.0, 'created_time': 1774608154.574378, 'last_price_update_time': 1774696228.545469}
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ83325') HTTP/1.1" 204 0
2026-03-28 11:10:28 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-28 11:10:28 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-28 11:10:28 [auto1.de] INFO: Scrape type for GA28860: 2
2026-03-28 11:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860
2026-03-28 11:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab1ca00-fb3f-5739-8785-2c59c1349aa6 with scrape type 2
2026-03-28 11:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab1ca00-fb3f-5739-8785-2c59c1349aa6 with scrape type 2
2026-03-28 11:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dab1ca00-fb3f-5739-8785-2c59c1349aa6, identifier: GA28860
2026-03-28 11:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860
2026-03-28 11:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860
2026-03-28 11:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dab1ca00-fb3f-5739-8785-2c59c1349aa6 with identifier: GA28860 to the API
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:54:27Z',
 'fuel_type': 'diesel',
 'id': 'dab1ca00-fb3f-5739-8785-2c59c1349aa6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA28860',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Grand Sport',
 'odometer': 186474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Opel Insignia Grand Sport 2.0 CDTI Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2019}
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-28 11:10:28 [auto1.de] INFO: Saving data for GA28860: {'auction_closing_time': 1774716867.0, 'created_time': 1773775730.393811, 'last_price_update_time': 1774696228.980385}
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA28860') HTTP/1.1" 204 0
2026-03-28 11:10:29 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [auto1.de] INFO: Scrape type for JL37437: 2
2026-03-28 11:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437
2026-03-28 11:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7db25ba-476e-5bef-b9f9-71b27ebce11c with scrape type 2
2026-03-28 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7db25ba-476e-5bef-b9f9-71b27ebce11c with scrape type 2
2026-03-28 11:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7db25ba-476e-5bef-b9f9-71b27ebce11c, identifier: JL37437
2026-03-28 11:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437
2026-03-28 11:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437
2026-03-28 11:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7db25ba-476e-5bef-b9f9-71b27ebce11c with identifier: JL37437 to the API
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:09:43Z',
 'fuel_type': 'diesel',
 'id': 'a7db25ba-476e-5bef-b9f9-71b27ebce11c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL37437',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Transporter',
 'odometer': 181174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1995-02-14',
 'seller_name': None,
 'title': 'Volkswagen T4 Transporter 1.9 Turbodiesel Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 1995}
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [auto1.de] INFO: Saving data for JL37437: {'auction_closing_time': 1774714183.0, 'created_time': 1773382135.095408, 'last_price_update_time': 1774696229.476537}
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL37437') HTTP/1.1" 204 0
2026-03-28 11:10:29 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [auto1.de] INFO: Scrape type for DG62846: 2
2026-03-28 11:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846
2026-03-28 11:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5400fba-3052-52cc-9d93-1ee91d165148 with scrape type 2
2026-03-28 11:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5400fba-3052-52cc-9d93-1ee91d165148 with scrape type 2
2026-03-28 11:10:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5400fba-3052-52cc-9d93-1ee91d165148, identifier: DG62846
2026-03-28 11:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846
2026-03-28 11:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846
2026-03-28 11:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5400fba-3052-52cc-9d93-1ee91d165148 with identifier: DG62846 to the API
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:16:20Z',
 'fuel_type': 'petrol',
 'id': 'd5400fba-3052-52cc-9d93-1ee91d165148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG62846',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 57628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-31',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [auto1.de] INFO: Saving data for DG62846: {'auction_closing_time': 1774714580.0, 'created_time': 1773659096.375404, 'last_price_update_time': 1774696230.141521}
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG62846') HTTP/1.1" 204 0
2026-03-28 11:10:30 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [auto1.de] INFO: Scrape type for NB80689: 2
2026-03-28 11:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689
2026-03-28 11:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e94735-3121-58c7-88ea-84870541eb6a with scrape type 2
2026-03-28 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e94735-3121-58c7-88ea-84870541eb6a with scrape type 2
2026-03-28 11:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3e94735-3121-58c7-88ea-84870541eb6a, identifier: NB80689
2026-03-28 11:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689
2026-03-28 11:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689
2026-03-28 11:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3e94735-3121-58c7-88ea-84870541eb6a with identifier: NB80689 to the API
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:41:26Z',
 'fuel_type': 'petrol',
 'id': 'a3e94735-3121-58c7-88ea-84870541eb6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB80689',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 183366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [auto1.de] INFO: Saving data for NB80689: {'auction_closing_time': 1774716086.0, 'created_time': 1773775996.657466, 'last_price_update_time': 1774696230.645292}
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB80689') HTTP/1.1" 204 0
2026-03-28 11:10:30 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [auto1.de] INFO: Scrape type for VV98645: 2
2026-03-28 11:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645
2026-03-28 11:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4722b5-fc94-57d1-b572-f0cc66851d4c with scrape type 2
2026-03-28 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb4722b5-fc94-57d1-b572-f0cc66851d4c with scrape type 2
2026-03-28 11:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb4722b5-fc94-57d1-b572-f0cc66851d4c, identifier: VV98645
2026-03-28 11:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645
2026-03-28 11:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645
2026-03-28 11:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb4722b5-fc94-57d1-b572-f0cc66851d4c with identifier: VV98645 to the API
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:48:58Z',
 'fuel_type': 'diesel',
 'id': 'eb4722b5-fc94-57d1-b572-f0cc66851d4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV98645',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 153771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-19',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2014}
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [auto1.de] INFO: Saving data for VV98645: {'auction_closing_time': 1774716538.0, 'created_time': 1774292360.758484, 'last_price_update_time': 1774696231.345495}
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV98645') HTTP/1.1" 204 0
2026-03-28 11:10:31 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [auto1.de] INFO: Scrape type for NN79660: 2
2026-03-28 11:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660
2026-03-28 11:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with scrape type 2
2026-03-28 11:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with scrape type 2
2026-03-28 11:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d, identifier: NN79660
2026-03-28 11:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660
2026-03-28 11:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660
2026-03-28 11:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ab8c9ee-88fa-56a1-bfe5-5139cebf843d with identifier: NN79660 to the API
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:17:22Z',
 'fuel_type': 'diesel',
 'id': '5ab8c9ee-88fa-56a1-bfe5-5139cebf843d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN79660',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-15',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 317 CDI Kasten L2',
 'transmission': 'automatic',
 'trim': 'Kasten L2',
 'year': 2025}
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [auto1.de] INFO: Saving data for NN79660: {'auction_closing_time': 1774714642.0, 'created_time': 1773304162.915518, 'last_price_update_time': 1774696231.78028}
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN79660') HTTP/1.1" 204 0
2026-03-28 11:10:31 [auto1.de] INFO: Channel: 24h | Page: 217 | totalHits: 9709 | hits on page: 40
2026-03-28 11:10:31 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [auto1.de] INFO: Scrape type for JV89856: 2
2026-03-28 11:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856
2026-03-28 11:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with scrape type 2
2026-03-28 11:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with scrape type 2
2026-03-28 11:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94, identifier: JV89856
2026-03-28 11:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856
2026-03-28 11:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856
2026-03-28 11:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90fe141c-7c36-5dbf-9580-66dd0d7bfd94 with identifier: JV89856 to the API
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:53:23Z',
 'fuel_type': 'petrol',
 'id': '90fe141c-7c36-5dbf-9580-66dd0d7bfd94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV89856',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 24250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-17',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [auto1.de] INFO: Saving data for JV89856: {'auction_closing_time': 1774716803.0, 'created_time': 1773687305.07223, 'last_price_update_time': 1774696232.281188}
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV89856') HTTP/1.1" 204 0
2026-03-28 11:10:32 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [auto1.de] INFO: Scrape type for JS29851: 2
2026-03-28 11:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851
2026-03-28 11:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with scrape type 2
2026-03-28 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with scrape type 2
2026-03-28 11:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7abbbe02-7b71-5312-a9dd-9c6332e77b83, identifier: JS29851
2026-03-28 11:10:32 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [auto1.de] INFO: Scrape type for KG22409: 2
2026-03-28 11:10:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409
2026-03-28 11:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with scrape type 2
2026-03-28 11:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with scrape type 2
2026-03-28 11:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2, identifier: KG22409
2026-03-28 11:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851
2026-03-28 11:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851
2026-03-28 11:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7abbbe02-7b71-5312-a9dd-9c6332e77b83 with identifier: JS29851 to the API
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:48:09Z',
 'fuel_type': 'diesel',
 'id': '7abbbe02-7b71-5312-a9dd-9c6332e77b83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS29851',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 295365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-28',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [auto1.de] INFO: Saving data for JS29851: {'auction_closing_time': 1774716489.0, 'created_time': 1774294352.430586, 'last_price_update_time': 1774696232.842235}
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS29851') HTTP/1.1" 204 0
2026-03-28 11:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409
2026-03-28 11:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409
2026-03-28 11:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c9e8a1f-2169-5a61-a85c-c33e75f596c2 with identifier: KG22409 to the API
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:19:12Z',
 'fuel_type': 'diesel',
 'id': '8c9e8a1f-2169-5a61-a85c-c33e75f596c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG22409',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 239016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-30',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-28 11:10:33 [auto1.de] INFO: Saving data for KG22409: {'auction_closing_time': 1774714752.0, 'created_time': 1773305406.813429, 'last_price_update_time': 1774696233.267381}
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG22409') HTTP/1.1" 204 0
2026-03-28 11:10:33 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-28 11:10:33 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-28 11:10:33 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-28 11:10:33 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-28 11:10:33 [auto1.de] INFO: Scrape type for TB33384: 2
2026-03-28 11:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384
2026-03-28 11:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7693f19-c320-5040-bb7b-fb5236ae8153 with scrape type 2
2026-03-28 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7693f19-c320-5040-bb7b-fb5236ae8153 with scrape type 2
2026-03-28 11:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7693f19-c320-5040-bb7b-fb5236ae8153, identifier: TB33384
2026-03-28 11:10:33 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-28 11:10:33 [auto1.de] INFO: Scrape type for PL79897: 2
2026-03-28 11:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897
2026-03-28 11:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with scrape type 2
2026-03-28 11:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with scrape type 2
2026-03-28 11:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbb187ba-a4f7-5da6-991d-f766bc2c40f5, identifier: PL79897
2026-03-28 11:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384
2026-03-28 11:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384
2026-03-28 11:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7693f19-c320-5040-bb7b-fb5236ae8153 with identifier: TB33384 to the API
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-28T16:17:14Z',
 'fuel_type': 'diesel',
 'id': 'b7693f19-c320-5040-bb7b-fb5236ae8153',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB33384',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 84430,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-28 11:10:33 [auto1.de] INFO: Saving data for TB33384: {'auction_closing_time': 1774714634.0, 'created_time': 1773307184.877723, 'last_price_update_time': 1774696233.774017}
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB33384') HTTP/1.1" 204 0
2026-03-28 11:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897
2026-03-28 11:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897
2026-03-28 11:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbb187ba-a4f7-5da6-991d-f766bc2c40f5 with identifier: PL79897 to the API
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:55:23Z',
 'fuel_type': 'petrol',
 'id': 'dbb187ba-a4f7-5da6-991d-f766bc2c40f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL79897',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 25279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-28',
 'seller_name': None,
 'title': 'Citroen C4 1.2 PureTech Shine',
 'transmission': 'automatic',
 'trim': 'Shine',
 'year': 2023}
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-28 11:10:34 [auto1.de] INFO: Saving data for PL79897: {'auction_closing_time': 1774716923.0, 'created_time': 1774293908.438891, 'last_price_update_time': 1774696234.078998}
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL79897') HTTP/1.1" 204 0
2026-03-28 11:10:34 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-28 11:10:34 [auto1.de] INFO: Scrape type for WZ21973: 2
2026-03-28 11:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973
2026-03-28 11:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8190a8f7-7760-5055-b346-917965981869 with scrape type 2
2026-03-28 11:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8190a8f7-7760-5055-b346-917965981869 with scrape type 2
2026-03-28 11:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8190a8f7-7760-5055-b346-917965981869, identifier: WZ21973
2026-03-28 11:10:34 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-28 11:10:34 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-28 11:10:34 [auto1.de] INFO: Scrape type for HD41373: 2
2026-03-28 11:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373
2026-03-28 11:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f85bf86-1906-540b-ae61-c658748f15ce with scrape type 2
2026-03-28 11:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f85bf86-1906-540b-ae61-c658748f15ce with scrape type 2
2026-03-28 11:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f85bf86-1906-540b-ae61-c658748f15ce, identifier: HD41373
2026-03-28 11:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973
2026-03-28 11:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973
2026-03-28 11:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8190a8f7-7760-5055-b346-917965981869 with identifier: WZ21973 to the API
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 50,
 'expiration_date': '2026-03-28T16:01:38Z',
 'fuel_type': 'petrol',
 'id': '8190a8f7-7760-5055-b346-917965981869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ21973',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Lupo',
 'odometer': 80907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-28',
 'seller_name': None,
 'title': 'Volkswagen Lupo 1.0 Rave',
 'transmission': 'manual',
 'trim': 'Rave',
 'year': 2005}
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-28 11:10:34 [auto1.de] INFO: Saving data for WZ21973: {'auction_closing_time': 1774713698.0, 'created_time': 1774118809.300286, 'last_price_update_time': 1774696234.632228}
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ21973') HTTP/1.1" 204 0
2026-03-28 11:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373
2026-03-28 11:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373
2026-03-28 11:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f85bf86-1906-540b-ae61-c658748f15ce with identifier: HD41373 to the API
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:53:17Z',
 'fuel_type': 'diesel',
 'id': '9f85bf86-1906-540b-ae61-c658748f15ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD41373',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 187442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-19',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-28 11:10:34 [auto1.de] INFO: Saving data for HD41373: {'auction_closing_time': 1774716797.0, 'created_time': 1773776049.998221, 'last_price_update_time': 1774696234.944459}
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD41373') HTTP/1.1" 204 0
2026-03-28 11:10:34 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-28 11:10:34 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-28 11:10:34 [auto1.de] INFO: Scrape type for RB25738: 2
2026-03-28 11:10:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738
2026-03-28 11:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with scrape type 2
2026-03-28 11:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with scrape type 2
2026-03-28 11:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45, identifier: RB25738
2026-03-28 11:10:35 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-28 11:10:35 [auto1.de] INFO: Scrape type for YX31470: 2
2026-03-28 11:10:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470
2026-03-28 11:10:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16114773-44e1-55d2-8dc9-4677562bd431 with scrape type 2
2026-03-28 11:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16114773-44e1-55d2-8dc9-4677562bd431 with scrape type 2
2026-03-28 11:10:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16114773-44e1-55d2-8dc9-4677562bd431, identifier: YX31470
2026-03-28 11:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738
2026-03-28 11:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738
2026-03-28 11:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c1a2099-0c16-53e5-aca6-4a76cc3efb45 with identifier: RB25738 to the API
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:26:26Z',
 'fuel_type': 'diesel',
 'id': '0c1a2099-0c16-53e5-aca6-4a76cc3efb45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB25738',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 196698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2017}
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-28 11:10:35 [auto1.de] INFO: Saving data for RB25738: {'auction_closing_time': 1774715186.0, 'created_time': 1773775461.967046, 'last_price_update_time': 1774696235.50274}
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB25738') HTTP/1.1" 204 0
2026-03-28 11:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470
2026-03-28 11:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470
2026-03-28 11:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16114773-44e1-55d2-8dc9-4677562bd431 with identifier: YX31470 to the API
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:24:51Z',
 'fuel_type': 'diesel',
 'id': '16114773-44e1-55d2-8dc9-4677562bd431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX31470',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 196991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-22',
 'seller_name': None,
 'title': 'BMW X6 xDrive 40d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-28 11:10:35 [auto1.de] INFO: Saving data for YX31470: {'auction_closing_time': 1774715091.0, 'created_time': 1773467112.562213, 'last_price_update_time': 1774696235.968212}
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX31470') HTTP/1.1" 204 0
2026-03-28 11:10:35 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-28 11:10:36 [auto1.de] INFO: Scrape type for PR56411: 2
2026-03-28 11:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411
2026-03-28 11:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54827405-4c25-51bb-abc2-5e8043bc3c6d with scrape type 2
2026-03-28 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54827405-4c25-51bb-abc2-5e8043bc3c6d with scrape type 2
2026-03-28 11:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54827405-4c25-51bb-abc2-5e8043bc3c6d, identifier: PR56411
2026-03-28 11:10:36 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-28 11:10:36 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-28 11:10:36 [auto1.de] INFO: Scrape type for PC35903: 2
2026-03-28 11:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903
2026-03-28 11:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63c61a93-29a7-57cb-a99f-b685e5dea09c with scrape type 2
2026-03-28 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63c61a93-29a7-57cb-a99f-b685e5dea09c with scrape type 2
2026-03-28 11:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63c61a93-29a7-57cb-a99f-b685e5dea09c, identifier: PC35903
2026-03-28 11:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411
2026-03-28 11:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411
2026-03-28 11:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54827405-4c25-51bb-abc2-5e8043bc3c6d with identifier: PR56411 to the API
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:52:01Z',
 'fuel_type': 'petrol',
 'id': '54827405-4c25-51bb-abc2-5e8043bc3c6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR56411',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 142346,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-13',
 'seller_name': None,
 'title': 'Volvo V90 2.0 T4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2018}
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-28 11:10:36 [auto1.de] INFO: Saving data for PR56411: {'auction_closing_time': 1774716721.0, 'created_time': 1773858952.110516, 'last_price_update_time': 1774696236.53862}
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR56411') HTTP/1.1" 204 0
2026-03-28 11:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903
2026-03-28 11:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903
2026-03-28 11:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63c61a93-29a7-57cb-a99f-b685e5dea09c with identifier: PC35903 to the API
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:05:50Z',
 'fuel_type': 'petrol',
 'id': '63c61a93-29a7-57cb-a99f-b685e5dea09c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC35903',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 88460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-28 11:10:36 [auto1.de] INFO: Saving data for PC35903: {'auction_closing_time': 1774713950.0, 'created_time': 1773399707.834131, 'last_price_update_time': 1774696236.893321}
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC35903') HTTP/1.1" 204 0
2026-03-28 11:10:36 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-28 11:10:36 [auto1.de] INFO: Scrape type for KC98509: 2
2026-03-28 11:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509
2026-03-28 11:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e32fb9f9-eae3-5351-b884-495dfcd6aafa with scrape type 2
2026-03-28 11:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e32fb9f9-eae3-5351-b884-495dfcd6aafa with scrape type 2
2026-03-28 11:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e32fb9f9-eae3-5351-b884-495dfcd6aafa, identifier: KC98509
2026-03-28 11:10:37 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-28 11:10:37 [auto1.de] INFO: Scrape type for GD48947: 2
2026-03-28 11:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947
2026-03-28 11:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e74d3abc-421f-5100-aa4f-fbc197713ee8 with scrape type 2
2026-03-28 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e74d3abc-421f-5100-aa4f-fbc197713ee8 with scrape type 2
2026-03-28 11:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e74d3abc-421f-5100-aa4f-fbc197713ee8, identifier: GD48947
2026-03-28 11:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509
2026-03-28 11:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509
2026-03-28 11:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e32fb9f9-eae3-5351-b884-495dfcd6aafa with identifier: KC98509 to the API
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:36:58Z',
 'fuel_type': 'diesel',
 'id': 'e32fb9f9-eae3-5351-b884-495dfcd6aafa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC98509',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 250642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-28',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-28 11:10:37 [auto1.de] INFO: Saving data for KC98509: {'auction_closing_time': 1774715818.0, 'created_time': 1774293697.003453, 'last_price_update_time': 1774696237.519998}
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC98509') HTTP/1.1" 204 0
2026-03-28 11:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947
2026-03-28 11:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947
2026-03-28 11:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e74d3abc-421f-5100-aa4f-fbc197713ee8 with identifier: GD48947 to the API
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:23:25Z',
 'fuel_type': 'petrol',
 'id': 'e74d3abc-421f-5100-aa4f-fbc197713ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD48947',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 106187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-16',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-28 11:10:37 [auto1.de] INFO: Saving data for GD48947: {'auction_closing_time': 1774715005.0, 'created_time': 1773341710.167857, 'last_price_update_time': 1774696237.87254}
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD48947') HTTP/1.1" 204 0
2026-03-28 11:10:37 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-28 11:10:37 [auto1.de] INFO: Scrape type for SD64601: 2
2026-03-28 11:10:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601
2026-03-28 11:10:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4608e656-4065-5d6d-87b2-6ea468e3d790 with scrape type 2
2026-03-28 11:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4608e656-4065-5d6d-87b2-6ea468e3d790 with scrape type 2
2026-03-28 11:10:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4608e656-4065-5d6d-87b2-6ea468e3d790, identifier: SD64601
2026-03-28 11:10:37 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-28 11:10:38 [auto1.de] INFO: Scrape type for JS29851: 0
2026-03-28 11:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601
2026-03-28 11:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601
2026-03-28 11:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4608e656-4065-5d6d-87b2-6ea468e3d790 with identifier: SD64601 to the API
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:14:23Z',
 'fuel_type': 'petrol',
 'id': '4608e656-4065-5d6d-87b2-6ea468e3d790',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD64601',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 124575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-17',
 'seller_name': None,
 'title': 'Renault Megane 1.2 Paris',
 'transmission': 'manual',
 'trim': 'Paris',
 'year': 2013}
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-28 11:10:38 [auto1.de] INFO: Saving data for SD64601: {'auction_closing_time': 1774714463.0, 'created_time': 1773772536.411584, 'last_price_update_time': 1774696238.296852}
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD64601') HTTP/1.1" 204 0
2026-03-28 11:10:38 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-28 11:10:38 [auto1.de] INFO: Scrape type for PA30689: 2
2026-03-28 11:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689
2026-03-28 11:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b759d130-765d-505a-8a0b-7214f4dc3273 with scrape type 2
2026-03-28 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b759d130-765d-505a-8a0b-7214f4dc3273 with scrape type 2
2026-03-28 11:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b759d130-765d-505a-8a0b-7214f4dc3273, identifier: PA30689
2026-03-28 11:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689
2026-03-28 11:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689
2026-03-28 11:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b759d130-765d-505a-8a0b-7214f4dc3273 with identifier: PA30689 to the API
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:18:57Z',
 'fuel_type': 'diesel',
 'id': 'b759d130-765d-505a-8a0b-7214f4dc3273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA30689',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 176638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-02',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2013}
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-28 11:10:38 [auto1.de] INFO: Saving data for PA30689: {'auction_closing_time': 1774714737.0, 'created_time': 1774294385.743561, 'last_price_update_time': 1774696238.699994}
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA30689') HTTP/1.1" 204 0
2026-03-28 11:10:38 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-28 11:10:38 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-28 11:10:38 [auto1.de] INFO: Scrape type for SD72223: 2
2026-03-28 11:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223
2026-03-28 11:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with scrape type 2
2026-03-28 11:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with scrape type 2
2026-03-28 11:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4, identifier: SD72223
2026-03-28 11:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223
2026-03-28 11:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223
2026-03-28 11:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cef0cdd-d5af-5f11-82bd-d2799e0558a4 with identifier: SD72223 to the API
2026-03-28 11:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:49:00Z',
 'fuel_type': 'petrol',
 'id': '8cef0cdd-d5af-5f11-82bd-d2799e0558a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD72223',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 36920,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-28',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Campus Authentique',
 'transmission': 'manual',
 'trim': 'Campus Authentique',
 'year': 2009}
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-28 11:10:39 [auto1.de] INFO: Saving data for SD72223: {'auction_closing_time': 1774716540.0, 'created_time': 1774608189.655334, 'last_price_update_time': 1774696239.111833}
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD72223') HTTP/1.1" 204 0
2026-03-28 11:10:39 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-28 11:10:39 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-28 11:10:39 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-28 11:10:39 [auto1.de] INFO: Scrape type for WE87101: 2
2026-03-28 11:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101
2026-03-28 11:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with scrape type 2
2026-03-28 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with scrape type 2
2026-03-28 11:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed, identifier: WE87101
2026-03-28 11:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101
2026-03-28 11:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101
2026-03-28 11:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75645dd4-8e13-5fc9-af5e-123ac71bf0ed with identifier: WE87101 to the API
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:10Z',
 'fuel_type': 'diesel',
 'id': '75645dd4-8e13-5fc9-af5e-123ac71bf0ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE87101',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 213012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-25',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-28 11:10:39 [auto1.de] INFO: Saving data for WE87101: {'auction_closing_time': 1774714390.0, 'created_time': 1773305537.484248, 'last_price_update_time': 1774696239.548747}
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE87101') HTTP/1.1" 204 0
2026-03-28 11:10:39 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-28 11:10:39 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-28 11:10:39 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-28 11:10:39 [auto1.de] INFO: Scrape type for JB08013: 2
2026-03-28 11:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013
2026-03-28 11:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e6d0ad-e90b-5313-b0d3-eac18c29479b with scrape type 2
2026-03-28 11:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e6d0ad-e90b-5313-b0d3-eac18c29479b with scrape type 2
2026-03-28 11:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40e6d0ad-e90b-5313-b0d3-eac18c29479b, identifier: JB08013
2026-03-28 11:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013
2026-03-28 11:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013
2026-03-28 11:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40e6d0ad-e90b-5313-b0d3-eac18c29479b with identifier: JB08013 to the API
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:34:35Z',
 'fuel_type': 'petrol',
 'id': '40e6d0ad-e90b-5313-b0d3-eac18c29479b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB08013',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 131935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2018}
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-28 11:10:40 [auto1.de] INFO: Saving data for JB08013: {'auction_closing_time': 1774715675.0, 'created_time': 1773401925.625186, 'last_price_update_time': 1774696240.084919}
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB08013') HTTP/1.1" 204 0
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-28 11:10:40 [auto1.de] INFO: Scrape type for SR18060: 2
2026-03-28 11:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060
2026-03-28 11:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e94f724-ab19-5609-b614-27fc9bcc81e4 with scrape type 2
2026-03-28 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e94f724-ab19-5609-b614-27fc9bcc81e4 with scrape type 2
2026-03-28 11:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e94f724-ab19-5609-b614-27fc9bcc81e4, identifier: SR18060
2026-03-28 11:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060
2026-03-28 11:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060
2026-03-28 11:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e94f724-ab19-5609-b614-27fc9bcc81e4 with identifier: SR18060 to the API
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:28:05Z',
 'fuel_type': 'petrol',
 'id': '7e94f724-ab19-5609-b614-27fc9bcc81e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR18060',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 112397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-29',
 'seller_name': None,
 'title': 'Opel Meriva 1.8 Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2008}
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-28 11:10:40 [auto1.de] INFO: Saving data for SR18060: {'auction_closing_time': 1774715285.0, 'created_time': 1773306171.017235, 'last_price_update_time': 1774696240.469099}
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR18060') HTTP/1.1" 204 0
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-28 11:10:40 [auto1.de] INFO: Scrape type for CK11382: 2
2026-03-28 11:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382
2026-03-28 11:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with scrape type 2
2026-03-28 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with scrape type 2
2026-03-28 11:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749, identifier: CK11382
2026-03-28 11:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382
2026-03-28 11:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382
2026-03-28 11:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a0d12bf-fe4a-5afa-b364-f03b4fc1f749 with identifier: CK11382 to the API
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:35:35Z',
 'fuel_type': 'diesel',
 'id': '8a0d12bf-fe4a-5afa-b364-f03b4fc1f749',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK11382',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 216450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Renault Megane 1.9 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2011}
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-28 11:10:40 [auto1.de] INFO: Saving data for CK11382: {'auction_closing_time': 1774715735.0, 'created_time': 1773429299.121517, 'last_price_update_time': 1774696240.909648}
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK11382') HTTP/1.1" 204 0
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: EJ54624
2026-03-28 11:10:40 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-28 11:10:40 [auto1.de] INFO: Scrape type for TV47355: 2
2026-03-28 11:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355
2026-03-28 11:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with scrape type 2
2026-03-28 11:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with scrape type 2
2026-03-28 11:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5, identifier: TV47355
2026-03-28 11:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355
2026-03-28 11:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355
2026-03-28 11:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c3cdf52-59c3-5208-b551-6bc3db9ad5d5 with identifier: TV47355 to the API
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:45:38Z',
 'fuel_type': 'petrol',
 'id': '6c3cdf52-59c3-5208-b551-6bc3db9ad5d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV47355',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'BRZ',
 'odometer': 17574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-14',
 'seller_name': None,
 'title': 'Subaru BRZ 2.0 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-28 11:10:41 [auto1.de] INFO: Saving data for TV47355: {'auction_closing_time': 1774716338.0, 'created_time': 1773307327.403504, 'last_price_update_time': 1774696241.364048}
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV47355') HTTP/1.1" 204 0
2026-03-28 11:10:41 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-28 11:10:41 [auto1.de] INFO: Scrape type for MK04993: 2
2026-03-28 11:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993
2026-03-28 11:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with scrape type 2
2026-03-28 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with scrape type 2
2026-03-28 11:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bc3b66c-4eee-50e6-8696-fbd62b006d81, identifier: MK04993
2026-03-28 11:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993
2026-03-28 11:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993
2026-03-28 11:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bc3b66c-4eee-50e6-8696-fbd62b006d81 with identifier: MK04993 to the API
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:03:56Z',
 'fuel_type': 'diesel',
 'id': '3bc3b66c-4eee-50e6-8696-fbd62b006d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK04993',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 322462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-21',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Active Plus Edition',
 'transmission': 'manual',
 'trim': 'Active Plus Edition',
 'year': 2012}
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-28 11:10:41 [auto1.de] INFO: Saving data for MK04993: {'auction_closing_time': 1774713836.0, 'created_time': 1773303164.589758, 'last_price_update_time': 1774696241.883288}
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK04993') HTTP/1.1" 204 0
2026-03-28 11:10:41 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-28 11:10:41 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-28 11:10:41 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-28 11:10:41 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-28 11:10:41 [auto1.de] INFO: Scrape type for XP57282: 2
2026-03-28 11:10:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282
2026-03-28 11:10:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with scrape type 2
2026-03-28 11:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with scrape type 2
2026-03-28 11:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cf53482-cc35-5f32-8bdd-bd28d0971f95, identifier: XP57282
2026-03-28 11:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282
2026-03-28 11:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282
2026-03-28 11:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cf53482-cc35-5f32-8bdd-bd28d0971f95 with identifier: XP57282 to the API
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:16:49Z',
 'fuel_type': 'petrol',
 'id': '5cf53482-cc35-5f32-8bdd-bd28d0971f95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP57282',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 104722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-28 11:10:42 [auto1.de] INFO: Saving data for XP57282: {'auction_closing_time': 1774714609.0, 'created_time': 1773381586.467769, 'last_price_update_time': 1774696242.306739}
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP57282') HTTP/1.1" 204 0
2026-03-28 11:10:42 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-28 11:10:42 [auto1.de] INFO: Scrape type for CZ09118: 2
2026-03-28 11:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118
2026-03-28 11:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b124c392-0426-5da5-a312-448a6fee290b with scrape type 2
2026-03-28 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b124c392-0426-5da5-a312-448a6fee290b with scrape type 2
2026-03-28 11:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b124c392-0426-5da5-a312-448a6fee290b, identifier: CZ09118
2026-03-28 11:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118
2026-03-28 11:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118
2026-03-28 11:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b124c392-0426-5da5-a312-448a6fee290b with identifier: CZ09118 to the API
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:25Z',
 'fuel_type': 'diesel',
 'id': 'b124c392-0426-5da5-a312-448a6fee290b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ09118',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 124628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
 'transmission': 'manual',
 'trim': 'Center-Line 2WD',
 'year': 2013}
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-28 11:10:42 [auto1.de] INFO: Saving data for CZ09118: {'auction_closing_time': 1774716265.0, 'created_time': 1773380777.39668, 'last_price_update_time': 1774696242.736182}
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ09118') HTTP/1.1" 204 0
2026-03-28 11:10:42 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-28 11:10:42 [auto1.de] INFO: Scrape type for NL95797: 2
2026-03-28 11:10:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797
2026-03-28 11:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8492b6fc-bacf-5dde-9866-4dd9dedca18d with scrape type 2
2026-03-28 11:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8492b6fc-bacf-5dde-9866-4dd9dedca18d with scrape type 2
2026-03-28 11:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8492b6fc-bacf-5dde-9866-4dd9dedca18d, identifier: NL95797
2026-03-28 11:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797
2026-03-28 11:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797
2026-03-28 11:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8492b6fc-bacf-5dde-9866-4dd9dedca18d with identifier: NL95797 to the API
2026-03-28 11:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:09:45Z',
 'fuel_type': 'petrol',
 'id': '8492b6fc-bacf-5dde-9866-4dd9dedca18d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL95797',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 212684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-06-22',
 'seller_name': None,
 'title': 'BMW 3er 323i',
 'transmission': 'automatic',
 'trim': '',
 'year': 1998}
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-28 11:10:43 [auto1.de] INFO: Saving data for NL95797: {'auction_closing_time': 1774714185.0, 'created_time': 1773304505.260979, 'last_price_update_time': 1774696243.143642}
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL95797') HTTP/1.1" 204 0
2026-03-28 11:10:43 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-28 11:10:43 [auto1.de] INFO: Scrape type for LM29335: 2
2026-03-28 11:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335
2026-03-28 11:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc3c853-802f-5962-991c-25050f35a253 with scrape type 2
2026-03-28 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffc3c853-802f-5962-991c-25050f35a253 with scrape type 2
2026-03-28 11:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffc3c853-802f-5962-991c-25050f35a253, identifier: LM29335
2026-03-28 11:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335
2026-03-28 11:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335
2026-03-28 11:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffc3c853-802f-5962-991c-25050f35a253 with identifier: LM29335 to the API
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:35Z',
 'fuel_type': 'diesel',
 'id': 'ffc3c853-802f-5962-991c-25050f35a253',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM29335',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-28 11:10:43 [auto1.de] INFO: Saving data for LM29335: {'auction_closing_time': 1774714595.0, 'created_time': 1773830710.363106, 'last_price_update_time': 1774696243.577698}
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM29335') HTTP/1.1" 204 0
2026-03-28 11:10:43 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-28 11:10:43 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-28 11:10:43 [auto1.de] INFO: Scrape type for AW80803: 2
2026-03-28 11:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803
2026-03-28 11:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with scrape type 2
2026-03-28 11:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with scrape type 2
2026-03-28 11:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037, identifier: AW80803
2026-03-28 11:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803
2026-03-28 11:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803
2026-03-28 11:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4023a4d-bbf6-5c67-8337-e0ce3cfc3037 with identifier: AW80803 to the API
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:25:08Z',
 'fuel_type': 'hybrid',
 'id': 'b4023a4d-bbf6-5c67-8337-e0ce3cfc3037',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW80803',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 21405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-15',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 250e Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2024}
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-28 11:10:43 [auto1.de] INFO: Saving data for AW80803: {'auction_closing_time': 1774715108.0, 'created_time': 1772728430.984605, 'last_price_update_time': 1774696243.985367}
2026-03-28 11:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW80803') HTTP/1.1" 204 0
2026-03-28 11:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:10:47 [auto1.de] INFO: Channel: 24h | Page: 218 | totalHits: 9709 | hits on page: 40
2026-03-28 11:10:47 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-28 11:10:47 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-28 11:10:47 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [auto1.de] INFO: Scrape type for SK86846: 2
2026-03-28 11:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846
2026-03-28 11:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b255f93a-f3a6-5684-9880-b9238c99a1d2 with scrape type 2
2026-03-28 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b255f93a-f3a6-5684-9880-b9238c99a1d2 with scrape type 2
2026-03-28 11:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b255f93a-f3a6-5684-9880-b9238c99a1d2, identifier: SK86846
2026-03-28 11:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846
2026-03-28 11:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846
2026-03-28 11:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b255f93a-f3a6-5684-9880-b9238c99a1d2 with identifier: SK86846 to the API
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-28T16:02:55Z',
 'fuel_type': 'petrol',
 'id': 'b255f93a-f3a6-5684-9880-b9238c99a1d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK86846',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 161946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-01',
 'seller_name': None,
 'title': 'BMW X5 4.8i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [auto1.de] INFO: Saving data for SK86846: {'auction_closing_time': 1774713775.0, 'created_time': 1773830968.221129, 'last_price_update_time': 1774696247.859383}
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK86846') HTTP/1.1" 204 0
2026-03-28 11:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:47 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [auto1.de] INFO: Scrape type for TD26953: 2
2026-03-28 11:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953
2026-03-28 11:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with scrape type 2
2026-03-28 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with scrape type 2
2026-03-28 11:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a876a45-a5c3-5dc1-9582-b545d2f499d4, identifier: TD26953
2026-03-28 11:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953
2026-03-28 11:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953
2026-03-28 11:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a876a45-a5c3-5dc1-9582-b545d2f499d4 with identifier: TD26953 to the API
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:27Z',
 'fuel_type': 'diesel',
 'id': '7a876a45-a5c3-5dc1-9582-b545d2f499d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD26953',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 209908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [auto1.de] INFO: Saving data for TD26953: {'auction_closing_time': 1774717047.0, 'created_time': 1773686361.194888, 'last_price_update_time': 1774696248.404875}
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD26953') HTTP/1.1" 204 0
2026-03-28 11:10:48 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-28 11:10:48 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-28 11:10:48 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-28 11:10:48 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [auto1.de] INFO: Scrape type for DW78199: 2
2026-03-28 11:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199
2026-03-28 11:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with scrape type 2
2026-03-28 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with scrape type 2
2026-03-28 11:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082, identifier: DW78199
2026-03-28 11:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199
2026-03-28 11:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199
2026-03-28 11:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56e1608e-d7cf-5a1a-9f42-3a8d91e81082 with identifier: DW78199 to the API
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:47:32Z',
 'fuel_type': 'petrol',
 'id': '56e1608e-d7cf-5a1a-9f42-3a8d91e81082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW78199',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 46733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-29',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [auto1.de] INFO: Saving data for DW78199: {'auction_closing_time': 1774716452.0, 'created_time': 1773304343.368967, 'last_price_update_time': 1774696248.827201}
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW78199') HTTP/1.1" 204 0
2026-03-28 11:10:48 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [auto1.de] INFO: Scrape type for CV81199: 2
2026-03-28 11:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199
2026-03-28 11:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6086a7-abd0-529e-8d19-e032a96ef630 with scrape type 2
2026-03-28 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d6086a7-abd0-529e-8d19-e032a96ef630 with scrape type 2
2026-03-28 11:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d6086a7-abd0-529e-8d19-e032a96ef630, identifier: CV81199
2026-03-28 11:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199
2026-03-28 11:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199
2026-03-28 11:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d6086a7-abd0-529e-8d19-e032a96ef630 with identifier: CV81199 to the API
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-28T16:25:22Z',
 'fuel_type': 'petrol',
 'id': '0d6086a7-abd0-529e-8d19-e032a96ef630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV81199',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 79840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-18',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sendo 2WD',
 'transmission': 'manual',
 'trim': 'Sendo 2WD',
 'year': 2014}
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [auto1.de] INFO: Saving data for CV81199: {'auction_closing_time': 1774715122.0, 'created_time': 1773775629.093129, 'last_price_update_time': 1774696249.292294}
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV81199') HTTP/1.1" 204 0
2026-03-28 11:10:49 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-28 11:10:49 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-28 11:10:49 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [auto1.de] INFO: Scrape type for UC14298: 2
2026-03-28 11:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298
2026-03-28 11:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18cedc76-8d4f-5334-a121-75261363c320 with scrape type 2
2026-03-28 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18cedc76-8d4f-5334-a121-75261363c320 with scrape type 2
2026-03-28 11:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18cedc76-8d4f-5334-a121-75261363c320, identifier: UC14298
2026-03-28 11:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298
2026-03-28 11:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298
2026-03-28 11:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18cedc76-8d4f-5334-a121-75261363c320 with identifier: UC14298 to the API
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:38:25Z',
 'fuel_type': 'petrol',
 'id': '18cedc76-8d4f-5334-a121-75261363c320',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC14298',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 149490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2012}
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [auto1.de] INFO: Saving data for UC14298: {'auction_closing_time': 1774715905.0, 'created_time': 1774608198.022563, 'last_price_update_time': 1774696249.700216}
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC14298') HTTP/1.1" 204 0
2026-03-28 11:10:49 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [auto1.de] INFO: Scrape type for AZ37362: 2
2026-03-28 11:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362
2026-03-28 11:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c378422-00d0-5dec-93ef-2380983fa76e with scrape type 2
2026-03-28 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c378422-00d0-5dec-93ef-2380983fa76e with scrape type 2
2026-03-28 11:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c378422-00d0-5dec-93ef-2380983fa76e, identifier: AZ37362
2026-03-28 11:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362
2026-03-28 11:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362
2026-03-28 11:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c378422-00d0-5dec-93ef-2380983fa76e with identifier: AZ37362 to the API
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:14:41Z',
 'fuel_type': 'petrol',
 'id': '7c378422-00d0-5dec-93ef-2380983fa76e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ37362',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 145058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Suzuki Swift 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [auto1.de] INFO: Saving data for AZ37362: {'auction_closing_time': 1774714481.0, 'created_time': 1774262560.543079, 'last_price_update_time': 1774696250.119288}
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ37362') HTTP/1.1" 204 0
2026-03-28 11:10:50 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [auto1.de] INFO: Scrape type for AS09440: 2
2026-03-28 11:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440
2026-03-28 11:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 675cf196-b202-5fca-90af-a3c77b8bb2f3 with scrape type 2
2026-03-28 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 675cf196-b202-5fca-90af-a3c77b8bb2f3 with scrape type 2
2026-03-28 11:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 675cf196-b202-5fca-90af-a3c77b8bb2f3, identifier: AS09440
2026-03-28 11:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440
2026-03-28 11:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440
2026-03-28 11:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 675cf196-b202-5fca-90af-a3c77b8bb2f3 with identifier: AS09440 to the API
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:16:19Z',
 'fuel_type': 'diesel',
 'id': '675cf196-b202-5fca-90af-a3c77b8bb2f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS09440',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 60319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-19',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L1H1 3,0t Komfort',
 'transmission': 'manual',
 'trim': 'L1H1 3,0t Komfort',
 'year': 2019}
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [auto1.de] INFO: Saving data for AS09440: {'auction_closing_time': 1774714579.0, 'created_time': 1774251399.23677, 'last_price_update_time': 1774696250.533904}
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS09440') HTTP/1.1" 204 0
2026-03-28 11:10:50 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [auto1.de] INFO: Scrape type for LG36185: 2
2026-03-28 11:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185
2026-03-28 11:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 591283d8-b198-55d6-a2df-cf90c3877490 with scrape type 2
2026-03-28 11:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 591283d8-b198-55d6-a2df-cf90c3877490 with scrape type 2
2026-03-28 11:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 591283d8-b198-55d6-a2df-cf90c3877490, identifier: LG36185
2026-03-28 11:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185
2026-03-28 11:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185
2026-03-28 11:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 591283d8-b198-55d6-a2df-cf90c3877490 with identifier: LG36185 to the API
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:04:48Z',
 'fuel_type': 'petrol',
 'id': '591283d8-b198-55d6-a2df-cf90c3877490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG36185',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 162440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-31',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Team Edition',
 'transmission': 'manual',
 'trim': 'Team Edition',
 'year': 2008}
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [auto1.de] INFO: Saving data for LG36185: {'auction_closing_time': 1774713888.0, 'created_time': 1773401981.478406, 'last_price_update_time': 1774696251.092271}
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG36185') HTTP/1.1" 204 0
2026-03-28 11:10:51 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-28 11:10:51 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [auto1.de] INFO: Scrape type for BH48904: 2
2026-03-28 11:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904
2026-03-28 11:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d265f54-893f-5175-a7fa-5e2db4b057f9 with scrape type 2
2026-03-28 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d265f54-893f-5175-a7fa-5e2db4b057f9 with scrape type 2
2026-03-28 11:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d265f54-893f-5175-a7fa-5e2db4b057f9, identifier: BH48904
2026-03-28 11:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904
2026-03-28 11:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904
2026-03-28 11:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d265f54-893f-5175-a7fa-5e2db4b057f9 with identifier: BH48904 to the API
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:57Z',
 'fuel_type': 'petrol',
 'id': '3d265f54-893f-5175-a7fa-5e2db4b057f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH48904',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 135257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-15',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [auto1.de] INFO: Saving data for BH48904: {'auction_closing_time': 1774716837.0, 'created_time': 1773429304.492301, 'last_price_update_time': 1774696251.532264}
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH48904') HTTP/1.1" 204 0
2026-03-28 11:10:51 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [auto1.de] INFO: Scrape type for KF96570: 2
2026-03-28 11:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570
2026-03-28 11:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49549133-b2d6-51ef-961b-e38cbc7b2dab with scrape type 2
2026-03-28 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49549133-b2d6-51ef-961b-e38cbc7b2dab with scrape type 2
2026-03-28 11:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49549133-b2d6-51ef-961b-e38cbc7b2dab, identifier: KF96570
2026-03-28 11:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570
2026-03-28 11:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570
2026-03-28 11:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49549133-b2d6-51ef-961b-e38cbc7b2dab with identifier: KF96570 to the API
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:16:35Z',
 'fuel_type': 'diesel',
 'id': '49549133-b2d6-51ef-961b-e38cbc7b2dab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF96570',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 224583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-05',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2017}
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [auto1.de] INFO: Saving data for KF96570: {'auction_closing_time': 1774714595.0, 'created_time': 1773775307.509811, 'last_price_update_time': 1774696251.943153}
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF96570') HTTP/1.1" 204 0
2026-03-28 11:10:51 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [auto1.de] INFO: Scrape type for FG75722: 2
2026-03-28 11:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722
2026-03-28 11:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde0ec8c-45aa-5e02-b369-316e5f37737a with scrape type 2
2026-03-28 11:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde0ec8c-45aa-5e02-b369-316e5f37737a with scrape type 2
2026-03-28 11:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cde0ec8c-45aa-5e02-b369-316e5f37737a, identifier: FG75722
2026-03-28 11:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722
2026-03-28 11:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722
2026-03-28 11:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cde0ec8c-45aa-5e02-b369-316e5f37737a with identifier: FG75722 to the API
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:32:46Z',
 'fuel_type': 'petrol',
 'id': 'cde0ec8c-45aa-5e02-b369-316e5f37737a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG75722',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 105146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-13',
 'seller_name': None,
 'title': 'Audi Q2 40 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-28 11:10:52 [auto1.de] INFO: Saving data for FG75722: {'auction_closing_time': 1774715566.0, 'created_time': 1773689318.878938, 'last_price_update_time': 1774696252.374029}
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG75722') HTTP/1.1" 204 0
2026-03-28 11:10:52 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-28 11:10:52 [auto1.de] INFO: Scrape type for AA34634: 2
2026-03-28 11:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634
2026-03-28 11:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with scrape type 2
2026-03-28 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with scrape type 2
2026-03-28 11:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97, identifier: AA34634
2026-03-28 11:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634
2026-03-28 11:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634
2026-03-28 11:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97 with identifier: AA34634 to the API
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:02:12Z',
 'fuel_type': 'diesel',
 'id': 'da1b60b5-24cc-5b7c-bfbc-2c133a3d2c97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA34634',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 212830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-20',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-28 11:10:52 [auto1.de] INFO: Saving data for AA34634: {'auction_closing_time': 1774713732.0, 'created_time': 1773305407.164739, 'last_price_update_time': 1774696252.778474}
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA34634') HTTP/1.1" 204 0
2026-03-28 11:10:52 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-28 11:10:52 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-28 11:10:52 [auto1.de] INFO: Scrape type for JE48122: 2
2026-03-28 11:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122
2026-03-28 11:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49de4338-c687-5252-8e6e-de7ca7a210f4 with scrape type 2
2026-03-28 11:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49de4338-c687-5252-8e6e-de7ca7a210f4 with scrape type 2
2026-03-28 11:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49de4338-c687-5252-8e6e-de7ca7a210f4, identifier: JE48122
2026-03-28 11:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122
2026-03-28 11:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122
2026-03-28 11:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49de4338-c687-5252-8e6e-de7ca7a210f4 with identifier: JE48122 to the API
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-28T16:39:08Z',
 'fuel_type': 'petrol',
 'id': '49de4338-c687-5252-8e6e-de7ca7a210f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE48122',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 120901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-11',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-28 11:10:53 [auto1.de] INFO: Saving data for JE48122: {'auction_closing_time': 1774715948.0, 'created_time': 1773858956.559618, 'last_price_update_time': 1774696253.2146}
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE48122') HTTP/1.1" 204 0
2026-03-28 11:10:53 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-28 11:10:53 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-28 11:10:53 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-28 11:10:53 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-28 11:10:53 [auto1.de] INFO: Scrape type for VN50855: 2
2026-03-28 11:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855
2026-03-28 11:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5ea6603-3a6d-5597-9c71-cef18cd9effd with scrape type 2
2026-03-28 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5ea6603-3a6d-5597-9c71-cef18cd9effd with scrape type 2
2026-03-28 11:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5ea6603-3a6d-5597-9c71-cef18cd9effd, identifier: VN50855
2026-03-28 11:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855
2026-03-28 11:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855
2026-03-28 11:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5ea6603-3a6d-5597-9c71-cef18cd9effd with identifier: VN50855 to the API
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:26:50Z',
 'fuel_type': 'petrol',
 'id': 'a5ea6603-3a6d-5597-9c71-cef18cd9effd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN50855',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 141178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-24',
 'seller_name': None,
 'title': 'BMW 3er 320i GT xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-28 11:10:53 [auto1.de] INFO: Saving data for VN50855: {'auction_closing_time': 1774715210.0, 'created_time': 1773308186.079954, 'last_price_update_time': 1774696253.622211}
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN50855') HTTP/1.1" 204 0
2026-03-28 11:10:53 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-28 11:10:53 [auto1.de] INFO: Scrape type for KE73798: 2
2026-03-28 11:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798
2026-03-28 11:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71af4e97-4731-5ae3-ad4c-183eef459ec3 with scrape type 2
2026-03-28 11:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71af4e97-4731-5ae3-ad4c-183eef459ec3 with scrape type 2
2026-03-28 11:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71af4e97-4731-5ae3-ad4c-183eef459ec3, identifier: KE73798
2026-03-28 11:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798
2026-03-28 11:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798
2026-03-28 11:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71af4e97-4731-5ae3-ad4c-183eef459ec3 with identifier: KE73798 to the API
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:03:02Z',
 'fuel_type': 'petrol',
 'id': '71af4e97-4731-5ae3-ad4c-183eef459ec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE73798',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 120659,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-20',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-28 11:10:54 [auto1.de] INFO: Saving data for KE73798: {'auction_closing_time': 1774713782.0, 'created_time': 1773306577.065688, 'last_price_update_time': 1774696254.208442}
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE73798') HTTP/1.1" 204 0
2026-03-28 11:10:54 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-28 11:10:54 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-28 11:10:54 [auto1.de] INFO: Scrape type for XH41107: 2
2026-03-28 11:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107
2026-03-28 11:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abd48081-2a26-54d5-b6c7-5a0e42b898fd with scrape type 2
2026-03-28 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abd48081-2a26-54d5-b6c7-5a0e42b898fd with scrape type 2
2026-03-28 11:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abd48081-2a26-54d5-b6c7-5a0e42b898fd, identifier: XH41107
2026-03-28 11:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107
2026-03-28 11:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107
2026-03-28 11:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abd48081-2a26-54d5-b6c7-5a0e42b898fd with identifier: XH41107 to the API
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:15:59Z',
 'fuel_type': 'petrol',
 'id': 'abd48081-2a26-54d5-b6c7-5a0e42b898fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH41107',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 75971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2020}
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-28 11:10:54 [auto1.de] INFO: Saving data for XH41107: {'auction_closing_time': 1774714559.0, 'created_time': 1774291419.585148, 'last_price_update_time': 1774696254.651377}
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH41107') HTTP/1.1" 204 0
2026-03-28 11:10:54 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-28 11:10:54 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-28 11:10:54 [auto1.de] INFO: Scrape type for VJ90236: 2
2026-03-28 11:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236
2026-03-28 11:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with scrape type 2
2026-03-28 11:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with scrape type 2
2026-03-28 11:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa, identifier: VJ90236
2026-03-28 11:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236
2026-03-28 11:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236
2026-03-28 11:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65ce3f8a-36b1-5e83-952b-6cfd301db4fa with identifier: VJ90236 to the API
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:05:07Z',
 'fuel_type': 'petrol',
 'id': '65ce3f8a-36b1-5e83-952b-6cfd301db4fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ90236',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 136123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-07',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-28 11:10:55 [auto1.de] INFO: Saving data for VJ90236: {'auction_closing_time': 1774713907.0, 'created_time': 1774608201.391241, 'last_price_update_time': 1774696255.081684}
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ90236') HTTP/1.1" 204 0
2026-03-28 11:10:55 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-28 11:10:55 [auto1.de] INFO: Scrape type for TS61714: 2
2026-03-28 11:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714
2026-03-28 11:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 644920f7-8d9d-5b33-9bcf-dee042fe0efe with scrape type 2
2026-03-28 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 644920f7-8d9d-5b33-9bcf-dee042fe0efe with scrape type 2
2026-03-28 11:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 644920f7-8d9d-5b33-9bcf-dee042fe0efe, identifier: TS61714
2026-03-28 11:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714
2026-03-28 11:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714
2026-03-28 11:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 644920f7-8d9d-5b33-9bcf-dee042fe0efe with identifier: TS61714 to the API
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:37:20Z',
 'fuel_type': 'petrol',
 'id': '644920f7-8d9d-5b33-9bcf-dee042fe0efe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS61714',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 111922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'Citroen C3 1.2 e-VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-28 11:10:55 [auto1.de] INFO: Saving data for TS61714: {'auction_closing_time': 1774715840.0, 'created_time': 1773657830.042563, 'last_price_update_time': 1774696255.490529}
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS61714') HTTP/1.1" 204 0
2026-03-28 11:10:55 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-28 11:10:55 [auto1.de] INFO: Scrape type for WZ35506: 2
2026-03-28 11:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506
2026-03-28 11:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with scrape type 2
2026-03-28 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with scrape type 2
2026-03-28 11:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2, identifier: WZ35506
2026-03-28 11:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506
2026-03-28 11:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506
2026-03-28 11:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2 with identifier: WZ35506 to the API
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:25:26Z',
 'fuel_type': 'diesel',
 'id': 'b0b0f3e2-01a2-51c9-ba9b-c2ff9fd03dd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ35506',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 199490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-08',
 'seller_name': None,
 'title': 'BMW 1er 120d xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2016}
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-28 11:10:55 [auto1.de] INFO: Saving data for WZ35506: {'auction_closing_time': 1774715126.0, 'created_time': 1773303641.468646, 'last_price_update_time': 1774696255.893549}
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ35506') HTTP/1.1" 204 0
2026-03-28 11:10:55 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-28 11:10:55 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-28 11:10:55 [auto1.de] INFO: Scrape type for KU38253: 2
2026-03-28 11:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253
2026-03-28 11:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84746ac-2602-5139-8e5d-b1962f4a5128 with scrape type 2
2026-03-28 11:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84746ac-2602-5139-8e5d-b1962f4a5128 with scrape type 2
2026-03-28 11:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d84746ac-2602-5139-8e5d-b1962f4a5128, identifier: KU38253
2026-03-28 11:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253
2026-03-28 11:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253
2026-03-28 11:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d84746ac-2602-5139-8e5d-b1962f4a5128 with identifier: KU38253 to the API
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-28T16:01:02Z',
 'fuel_type': 'petrol',
 'id': 'd84746ac-2602-5139-8e5d-b1962f4a5128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU38253',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 40593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-05',
 'seller_name': None,
 'title': 'Cupra Formentor 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2021}
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-28 11:10:56 [auto1.de] INFO: Saving data for KU38253: {'auction_closing_time': 1774713662.0, 'created_time': 1773306876.57381, 'last_price_update_time': 1774696256.323863}
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU38253') HTTP/1.1" 204 0
2026-03-28 11:10:56 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-28 11:10:56 [auto1.de] INFO: Scrape type for DR94699: 2
2026-03-28 11:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699
2026-03-28 11:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ecbeff-bd40-54df-908e-1b9c5783b25a with scrape type 2
2026-03-28 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ecbeff-bd40-54df-908e-1b9c5783b25a with scrape type 2
2026-03-28 11:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96ecbeff-bd40-54df-908e-1b9c5783b25a, identifier: DR94699
2026-03-28 11:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699
2026-03-28 11:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699
2026-03-28 11:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96ecbeff-bd40-54df-908e-1b9c5783b25a with identifier: DR94699 to the API
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:00Z',
 'fuel_type': 'diesel',
 'id': '96ecbeff-bd40-54df-908e-1b9c5783b25a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR94699',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 157714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-08',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2020}
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-28 11:10:56 [auto1.de] INFO: Saving data for DR94699: {'auction_closing_time': 1774715940.0, 'created_time': 1773308162.650486, 'last_price_update_time': 1774696256.79488}
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR94699') HTTP/1.1" 204 0
2026-03-28 11:10:56 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-28 11:10:56 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-28 11:10:56 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-28 11:10:56 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-28 11:10:56 [auto1.de] INFO: Scrape type for GG98787: 2
2026-03-28 11:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787
2026-03-28 11:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 201b1528-c597-568e-a491-95d8e6b5118b with scrape type 2
2026-03-28 11:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 201b1528-c597-568e-a491-95d8e6b5118b with scrape type 2
2026-03-28 11:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 201b1528-c597-568e-a491-95d8e6b5118b, identifier: GG98787
2026-03-28 11:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787
2026-03-28 11:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787
2026-03-28 11:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 201b1528-c597-568e-a491-95d8e6b5118b with identifier: GG98787 to the API
2026-03-28 11:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:07:52Z',
 'fuel_type': 'diesel',
 'id': '201b1528-c597-568e-a491-95d8e6b5118b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG98787',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 174877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2011}
2026-03-28 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-28 11:10:57 [auto1.de] INFO: Saving data for GG98787: {'auction_closing_time': 1774714072.0, 'created_time': 1774263223.255215, 'last_price_update_time': 1774696257.220885}
2026-03-28 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG98787') HTTP/1.1" 204 0
2026-03-28 11:10:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:10:58 [auto1.de] INFO: Channel: 24h | Page: 219 | totalHits: 9709 | hits on page: 40
2026-03-28 11:10:58 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-28 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-28 11:10:58 [auto1.de] INFO: Scrape type for KX98394: 2
2026-03-28 11:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394
2026-03-28 11:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beca0e64-c4a9-5fcd-b4e4-3500af629c35 with scrape type 2
2026-03-28 11:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beca0e64-c4a9-5fcd-b4e4-3500af629c35 with scrape type 2
2026-03-28 11:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: beca0e64-c4a9-5fcd-b4e4-3500af629c35, identifier: KX98394
2026-03-28 11:10:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394
2026-03-28 11:10:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394
2026-03-28 11:10:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: beca0e64-c4a9-5fcd-b4e4-3500af629c35 with identifier: KX98394 to the API
2026-03-28 11:10:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:28:45Z',
 'fuel_type': 'petrol',
 'id': 'beca0e64-c4a9-5fcd-b4e4-3500af629c35',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX98394',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 57974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-18',
 'seller_name': None,
 'title': 'Kia Rio 1.2 UEFA Euro 2016',
 'transmission': 'manual',
 'trim': 'UEFA Euro 2016',
 'year': 2016}
2026-03-28 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-28 11:10:58 [auto1.de] INFO: Saving data for KX98394: {'auction_closing_time': 1774715325.0, 'created_time': 1773772690.331679, 'last_price_update_time': 1774696258.98071}
2026-03-28 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX98394') HTTP/1.1" 204 0
2026-03-28 11:10:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:58 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-28 11:10:59 [auto1.de] INFO: Scrape type for GE96921: 2
2026-03-28 11:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921
2026-03-28 11:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with scrape type 2
2026-03-28 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with scrape type 2
2026-03-28 11:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2, identifier: GE96921
2026-03-28 11:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921
2026-03-28 11:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921
2026-03-28 11:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d39dd74-0625-51b9-ac43-4aed8c9fc7e2 with identifier: GE96921 to the API
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:36Z',
 'fuel_type': 'petrol',
 'id': '7d39dd74-0625-51b9-ac43-4aed8c9fc7e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE96921',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 43651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-25',
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-28 11:10:59 [auto1.de] INFO: Saving data for GE96921: {'auction_closing_time': 1774716456.0, 'created_time': 1773861194.299167, 'last_price_update_time': 1774696259.440572}
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE96921') HTTP/1.1" 204 0
2026-03-28 11:10:59 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-28 11:10:59 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-28 11:10:59 [auto1.de] INFO: Scrape type for BJ86438: 2
2026-03-28 11:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438
2026-03-28 11:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710dfe6e-ecd1-5759-b245-a32a27224915 with scrape type 2
2026-03-28 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710dfe6e-ecd1-5759-b245-a32a27224915 with scrape type 2
2026-03-28 11:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710dfe6e-ecd1-5759-b245-a32a27224915, identifier: BJ86438
2026-03-28 11:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438
2026-03-28 11:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438
2026-03-28 11:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710dfe6e-ecd1-5759-b245-a32a27224915 with identifier: BJ86438 to the API
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:07:30Z',
 'fuel_type': 'petrol',
 'id': '710dfe6e-ecd1-5759-b245-a32a27224915',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ86438',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 44971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-05',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2022}
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-28 11:10:59 [auto1.de] INFO: Saving data for BJ86438: {'auction_closing_time': 1774714050.0, 'created_time': 1773689325.288322, 'last_price_update_time': 1774696259.873767}
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ86438') HTTP/1.1" 204 0
2026-03-28 11:10:59 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-28 11:10:59 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-28 11:10:59 [auto1.de] INFO: Scrape type for CH51511: 2
2026-03-28 11:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511
2026-03-28 11:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 738521a3-734e-5a8e-b4c5-86f182dcd005 with scrape type 2
2026-03-28 11:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 738521a3-734e-5a8e-b4c5-86f182dcd005 with scrape type 2
2026-03-28 11:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 738521a3-734e-5a8e-b4c5-86f182dcd005, identifier: CH51511
2026-03-28 11:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511
2026-03-28 11:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511
2026-03-28 11:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 738521a3-734e-5a8e-b4c5-86f182dcd005 with identifier: CH51511 to the API
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:29:34Z',
 'fuel_type': 'diesel',
 'id': '738521a3-734e-5a8e-b4c5-86f182dcd005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH51511',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 165863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 d T BlueTEC Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2017}
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-28 11:11:00 [auto1.de] INFO: Saving data for CH51511: {'auction_closing_time': 1774715374.0, 'created_time': 1774262488.817953, 'last_price_update_time': 1774696260.31791}
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH51511') HTTP/1.1" 204 0
2026-03-28 11:11:00 [auto1.de] INFO: Found listing with ID: TR21109
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR21109%27 HTTP/1.1" 200 None
2026-03-28 11:11:00 [auto1.de] INFO: Scrape type for TR21109: 2
2026-03-28 11:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with identifier: TR21109
2026-03-28 11:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with scrape type 2
2026-03-28 11:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with scrape type 2
2026-03-28 11:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f0284cf-ee0b-5b38-8cf4-c16dde999800, identifier: TR21109
2026-03-28 11:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with identifier: TR21109
2026-03-28 11:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with identifier: TR21109
2026-03-28 11:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f0284cf-ee0b-5b38-8cf4-c16dde999800 with identifier: TR21109 to the API
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:02:43Z',
 'fuel_type': 'diesel',
 'id': '5f0284cf-ee0b-5b38-8cf4-c16dde999800',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR21109',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 92408,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-28',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2016}
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR21109%27 HTTP/1.1" 200 None
2026-03-28 11:11:00 [auto1.de] INFO: Saving data for TR21109: {'auction_closing_time': 1774713763.0, 'created_time': 1774292362.178927, 'last_price_update_time': 1774696260.724991}
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR21109') HTTP/1.1" 204 0
2026-03-28 11:11:00 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-28 11:11:00 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-28 11:11:00 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-28 11:11:00 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-28 11:11:00 [auto1.de] INFO: Scrape type for WK71622: 2
2026-03-28 11:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622
2026-03-28 11:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a73de4cc-bcff-56d8-9b06-21e32eb0beee with scrape type 2
2026-03-28 11:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a73de4cc-bcff-56d8-9b06-21e32eb0beee with scrape type 2
2026-03-28 11:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a73de4cc-bcff-56d8-9b06-21e32eb0beee, identifier: WK71622
2026-03-28 11:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622
2026-03-28 11:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622
2026-03-28 11:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a73de4cc-bcff-56d8-9b06-21e32eb0beee with identifier: WK71622 to the API
2026-03-28 11:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:54:40Z',
 'fuel_type': 'diesel',
 'id': 'a73de4cc-bcff-56d8-9b06-21e32eb0beee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK71622',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 169073,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-26',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-28 11:11:01 [auto1.de] INFO: Saving data for WK71622: {'auction_closing_time': 1774716880.0, 'created_time': 1773830234.05917, 'last_price_update_time': 1774696261.146047}
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK71622') HTTP/1.1" 204 0
2026-03-28 11:11:01 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-28 11:11:01 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-28 11:11:01 [auto1.de] INFO: Scrape type for ED74506: 2
2026-03-28 11:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506
2026-03-28 11:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with scrape type 2
2026-03-28 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with scrape type 2
2026-03-28 11:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd, identifier: ED74506
2026-03-28 11:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506
2026-03-28 11:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506
2026-03-28 11:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c4dea7a-2c50-5334-a5b0-26b2400eabdd with identifier: ED74506 to the API
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:50:13Z',
 'fuel_type': 'petrol',
 'id': '5c4dea7a-2c50-5334-a5b0-26b2400eabdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED74506',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 172690,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-18',
 'seller_name': None,
 'title': 'Audi A5 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-28 11:11:01 [auto1.de] INFO: Saving data for ED74506: {'auction_closing_time': 1774716613.0, 'created_time': 1774263626.30485, 'last_price_update_time': 1774696261.66066}
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED74506') HTTP/1.1" 204 0
2026-03-28 11:11:01 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-28 11:11:01 [auto1.de] INFO: Found listing with ID: EX10887
2026-03-28 11:11:01 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-28 11:11:01 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-28 11:11:01 [auto1.de] INFO: Scrape type for AG53647: 2
2026-03-28 11:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647
2026-03-28 11:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 284816dc-12a7-55b7-bbee-4c7e07c556db with scrape type 2
2026-03-28 11:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 284816dc-12a7-55b7-bbee-4c7e07c556db with scrape type 2
2026-03-28 11:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 284816dc-12a7-55b7-bbee-4c7e07c556db, identifier: AG53647
2026-03-28 11:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647
2026-03-28 11:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647
2026-03-28 11:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 284816dc-12a7-55b7-bbee-4c7e07c556db with identifier: AG53647 to the API
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:20:35Z',
 'fuel_type': 'diesel',
 'id': '284816dc-12a7-55b7-bbee-4c7e07c556db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG53647',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 248853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-22',
 'seller_name': None,
 'title': 'BMW 3er 330d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-28 11:11:02 [auto1.de] INFO: Saving data for AG53647: {'auction_closing_time': 1774714835.0, 'created_time': 1774380863.864437, 'last_price_update_time': 1774696262.082635}
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG53647') HTTP/1.1" 204 0
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-28 11:11:02 [auto1.de] INFO: Scrape type for RZ52630: 2
2026-03-28 11:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630
2026-03-28 11:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1795d8cc-6e31-5450-a9fe-2de425f44477 with scrape type 2
2026-03-28 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1795d8cc-6e31-5450-a9fe-2de425f44477 with scrape type 2
2026-03-28 11:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1795d8cc-6e31-5450-a9fe-2de425f44477, identifier: RZ52630
2026-03-28 11:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630
2026-03-28 11:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630
2026-03-28 11:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1795d8cc-6e31-5450-a9fe-2de425f44477 with identifier: RZ52630 to the API
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:49:00Z',
 'fuel_type': 'petrol',
 'id': '1795d8cc-6e31-5450-a9fe-2de425f44477',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ52630',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 263004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-04-25',
 'seller_name': None,
 'title': 'Volvo V70 2.4 R',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-28 11:11:02 [auto1.de] INFO: Saving data for RZ52630: {'auction_closing_time': 1774716540.0, 'created_time': 1774291891.655727, 'last_price_update_time': 1774696262.542726}
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ52630') HTTP/1.1" 204 0
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-28 11:11:02 [auto1.de] INFO: Scrape type for GY78752: 2
2026-03-28 11:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752
2026-03-28 11:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with scrape type 2
2026-03-28 11:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with scrape type 2
2026-03-28 11:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe, identifier: GY78752
2026-03-28 11:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752
2026-03-28 11:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752
2026-03-28 11:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 499baf1a-a7ea-5fb3-bc3f-9a390b546ffe with identifier: GY78752 to the API
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:11:17Z',
 'fuel_type': 'diesel',
 'id': '499baf1a-a7ea-5fb3-bc3f-9a390b546ffe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY78752',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 268358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-14',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2005}
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-28 11:11:02 [auto1.de] INFO: Saving data for GY78752: {'auction_closing_time': 1774714277.0, 'created_time': 1773859002.832086, 'last_price_update_time': 1774696262.976627}
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY78752') HTTP/1.1" 204 0
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: TV77789
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-28 11:11:02 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-28 11:11:03 [auto1.de] INFO: Scrape type for HJ79355: 2
2026-03-28 11:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355
2026-03-28 11:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8737b35-09db-5ffe-a6f5-bf867542d5dd with scrape type 2
2026-03-28 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8737b35-09db-5ffe-a6f5-bf867542d5dd with scrape type 2
2026-03-28 11:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8737b35-09db-5ffe-a6f5-bf867542d5dd, identifier: HJ79355
2026-03-28 11:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355
2026-03-28 11:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355
2026-03-28 11:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8737b35-09db-5ffe-a6f5-bf867542d5dd with identifier: HJ79355 to the API
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:54Z',
 'fuel_type': 'diesel',
 'id': 'b8737b35-09db-5ffe-a6f5-bf867542d5dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ79355',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 181415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-07',
 'seller_name': None,
 'title': 'Audi A3 Limousine 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-28 11:11:03 [auto1.de] INFO: Saving data for HJ79355: {'auction_closing_time': 1774717074.0, 'created_time': 1773831886.630188, 'last_price_update_time': 1774696263.412146}
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ79355') HTTP/1.1" 204 0
2026-03-28 11:11:03 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-28 11:11:03 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-28 11:11:03 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-28 11:11:03 [auto1.de] INFO: Scrape type for WW95477: 2
2026-03-28 11:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477
2026-03-28 11:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d97398-df78-57fd-99da-7f74d24771f7 with scrape type 2
2026-03-28 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d97398-df78-57fd-99da-7f74d24771f7 with scrape type 2
2026-03-28 11:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 56d97398-df78-57fd-99da-7f74d24771f7, identifier: WW95477
2026-03-28 11:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477
2026-03-28 11:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477
2026-03-28 11:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 56d97398-df78-57fd-99da-7f74d24771f7 with identifier: WW95477 to the API
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:10:48Z',
 'fuel_type': 'diesel',
 'id': '56d97398-df78-57fd-99da-7f74d24771f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW95477',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 97915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-08',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-28 11:11:03 [auto1.de] INFO: Saving data for WW95477: {'auction_closing_time': 1774714248.0, 'created_time': 1773304781.249491, 'last_price_update_time': 1774696263.922155}
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW95477') HTTP/1.1" 204 0
2026-03-28 11:11:03 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-28 11:11:03 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-28 11:11:03 [auto1.de] INFO: Scrape type for DJ77655: 2
2026-03-28 11:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655
2026-03-28 11:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7e69ea0-969a-5b3a-b99f-7c04949eec5a with scrape type 2
2026-03-28 11:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7e69ea0-969a-5b3a-b99f-7c04949eec5a with scrape type 2
2026-03-28 11:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7e69ea0-969a-5b3a-b99f-7c04949eec5a, identifier: DJ77655
2026-03-28 11:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655
2026-03-28 11:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655
2026-03-28 11:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7e69ea0-969a-5b3a-b99f-7c04949eec5a with identifier: DJ77655 to the API
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-28T16:39:07Z',
 'fuel_type': 'petrol',
 'id': 'c7e69ea0-969a-5b3a-b99f-7c04949eec5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ77655',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 141354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-14',
 'seller_name': None,
 'title': 'BMW X5 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-28 11:11:04 [auto1.de] INFO: Saving data for DJ77655: {'auction_closing_time': 1774715947.0, 'created_time': 1774294487.95957, 'last_price_update_time': 1774696264.370386}
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ77655') HTTP/1.1" 204 0
2026-03-28 11:11:04 [auto1.de] INFO: Channel: 24h | Page: 220 | totalHits: 9709 | hits on page: 40
2026-03-28 11:11:04 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-28 11:11:04 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-28 11:11:04 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-28 11:11:04 [auto1.de] INFO: Found listing with ID: KL29911
2026-03-28 11:11:04 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-28 11:11:04 [auto1.de] INFO: Scrape type for RM40239: 2
2026-03-28 11:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239
2026-03-28 11:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 649bbf99-953f-5080-840d-6d3ea40eafda with scrape type 2
2026-03-28 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 649bbf99-953f-5080-840d-6d3ea40eafda with scrape type 2
2026-03-28 11:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 649bbf99-953f-5080-840d-6d3ea40eafda, identifier: RM40239
2026-03-28 11:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239
2026-03-28 11:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239
2026-03-28 11:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 649bbf99-953f-5080-840d-6d3ea40eafda with identifier: RM40239 to the API
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:56:22Z',
 'fuel_type': 'diesel',
 'id': '649bbf99-953f-5080-840d-6d3ea40eafda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM40239',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 251786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-20',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 CDI Standard',
 'transmission': 'manual',
 'trim': 'Standard',
 'year': 2012}
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-28 11:11:04 [auto1.de] INFO: Saving data for RM40239: {'auction_closing_time': 1774716982.0, 'created_time': 1773401627.645399, 'last_price_update_time': 1774696264.799086}
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM40239') HTTP/1.1" 204 0
2026-03-28 11:11:04 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-28 11:11:04 [auto1.de] INFO: Scrape type for FM97642: 2
2026-03-28 11:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642
2026-03-28 11:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6bd0256-0743-5ed8-8305-5f6b668c863b with scrape type 2
2026-03-28 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6bd0256-0743-5ed8-8305-5f6b668c863b with scrape type 2
2026-03-28 11:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6bd0256-0743-5ed8-8305-5f6b668c863b, identifier: FM97642
2026-03-28 11:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:11:04 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-28 11:11:04 [auto1.de] INFO: Scrape type for JL50388: 2
2026-03-28 11:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388
2026-03-28 11:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with scrape type 2
2026-03-28 11:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with scrape type 2
2026-03-28 11:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2a3c5e7-e8fe-5f43-9035-59aa7760c088, identifier: JL50388
2026-03-28 11:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642
2026-03-28 11:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642
2026-03-28 11:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6bd0256-0743-5ed8-8305-5f6b668c863b with identifier: FM97642 to the API
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:05:27Z',
 'fuel_type': 'petrol',
 'id': 'a6bd0256-0743-5ed8-8305-5f6b668c863b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM97642',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 129504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2018}
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-28 11:11:05 [auto1.de] INFO: Saving data for FM97642: {'auction_closing_time': 1774713927.0, 'created_time': 1773401544.413465, 'last_price_update_time': 1774696265.330183}
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM97642') HTTP/1.1" 204 0
2026-03-28 11:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388
2026-03-28 11:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388
2026-03-28 11:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2a3c5e7-e8fe-5f43-9035-59aa7760c088 with identifier: JL50388 to the API
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:10:55Z',
 'fuel_type': 'diesel',
 'id': 'a2a3c5e7-e8fe-5f43-9035-59aa7760c088',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL50388',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 229957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-27',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-28 11:11:05 [auto1.de] INFO: Saving data for JL50388: {'auction_closing_time': 1774714255.0, 'created_time': 1773383867.613555, 'last_price_update_time': 1774696265.716212}
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL50388') HTTP/1.1" 204 0
2026-03-28 11:11:05 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-28 11:11:05 [auto1.de] INFO: Scrape type for UH05961: 2
2026-03-28 11:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961
2026-03-28 11:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef7df37-4800-551f-9796-4fcf1b2fa79f with scrape type 2
2026-03-28 11:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fef7df37-4800-551f-9796-4fcf1b2fa79f with scrape type 2
2026-03-28 11:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fef7df37-4800-551f-9796-4fcf1b2fa79f, identifier: UH05961
2026-03-28 11:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961
2026-03-28 11:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961
2026-03-28 11:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fef7df37-4800-551f-9796-4fcf1b2fa79f with identifier: UH05961 to the API
2026-03-28 11:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:11:58Z',
 'fuel_type': 'diesel',
 'id': 'fef7df37-4800-551f-9796-4fcf1b2fa79f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH05961',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 178237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-15',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Clever',
 'transmission': 'automatic',
 'trim': 'Clever',
 'year': 2018}
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-28 11:11:06 [auto1.de] INFO: Saving data for UH05961: {'auction_closing_time': 1774714318.0, 'created_time': 1773772561.125417, 'last_price_update_time': 1774696266.132089}
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH05961') HTTP/1.1" 204 0
2026-03-28 11:11:06 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-28 11:11:06 [auto1.de] INFO: Scrape type for GA86041: 2
2026-03-28 11:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041
2026-03-28 11:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f530195-018f-5dca-b409-d7a978557dfb with scrape type 2
2026-03-28 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f530195-018f-5dca-b409-d7a978557dfb with scrape type 2
2026-03-28 11:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f530195-018f-5dca-b409-d7a978557dfb, identifier: GA86041
2026-03-28 11:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041
2026-03-28 11:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041
2026-03-28 11:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f530195-018f-5dca-b409-d7a978557dfb with identifier: GA86041 to the API
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:34:25Z',
 'fuel_type': 'petrol',
 'id': '7f530195-018f-5dca-b409-d7a978557dfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA86041',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 164805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-28 11:11:06 [auto1.de] INFO: Saving data for GA86041: {'auction_closing_time': 1774715665.0, 'created_time': 1773306910.76262, 'last_price_update_time': 1774696266.543963}
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA86041') HTTP/1.1" 204 0
2026-03-28 11:11:06 [scrapy.extensions.logstats] INFO: Crawled 436 pages (at 6 pages/min), scraped 686 items (at 100 items/min)
2026-03-28 11:11:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:11:06 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-28 11:11:06 [auto1.de] INFO: Scrape type for SU94182: 2
2026-03-28 11:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182
2026-03-28 11:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acb26360-181a-57ec-8194-f333b80c7990 with scrape type 2
2026-03-28 11:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acb26360-181a-57ec-8194-f333b80c7990 with scrape type 2
2026-03-28 11:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acb26360-181a-57ec-8194-f333b80c7990, identifier: SU94182
2026-03-28 11:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182
2026-03-28 11:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182
2026-03-28 11:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acb26360-181a-57ec-8194-f333b80c7990 with identifier: SU94182 to the API
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:34:45Z',
 'fuel_type': 'petrol',
 'id': 'acb26360-181a-57ec-8194-f333b80c7990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU94182',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 91803,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-08',
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI Mild-Hybrid ACT S line',
 'transmission': 'automatic',
 'trim': 'ACT S line',
 'year': 2020}
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-28 11:11:06 [auto1.de] INFO: Saving data for SU94182: {'auction_closing_time': 1774715685.0, 'created_time': 1774293511.379683, 'last_price_update_time': 1774696266.990966}
2026-03-28 11:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU94182') HTTP/1.1" 204 0
2026-03-28 11:11:07 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-28 11:11:07 [auto1.de] INFO: Scrape type for GX08405: 2
2026-03-28 11:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405
2026-03-28 11:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3456634d-de35-50d2-bc34-707358a3ac0e with scrape type 2
2026-03-28 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3456634d-de35-50d2-bc34-707358a3ac0e with scrape type 2
2026-03-28 11:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3456634d-de35-50d2-bc34-707358a3ac0e, identifier: GX08405
2026-03-28 11:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405
2026-03-28 11:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405
2026-03-28 11:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3456634d-de35-50d2-bc34-707358a3ac0e with identifier: GX08405 to the API
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-28T16:53:20Z',
 'fuel_type': 'diesel',
 'id': '3456634d-de35-50d2-bc34-707358a3ac0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX08405',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 167316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-13',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-28 11:11:07 [auto1.de] INFO: Saving data for GX08405: {'auction_closing_time': 1774716800.0, 'created_time': 1773383178.714776, 'last_price_update_time': 1774696267.399892}
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX08405') HTTP/1.1" 204 0
2026-03-28 11:11:07 [auto1.de] INFO: Found listing with ID: TH70911
2026-03-28 11:11:07 [auto1.de] INFO: Found listing with ID: CK84203
2026-03-28 11:11:07 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-28 11:11:07 [auto1.de] INFO: Scrape type for UD17279: 2
2026-03-28 11:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279
2026-03-28 11:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with scrape type 2
2026-03-28 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with scrape type 2
2026-03-28 11:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d, identifier: UD17279
2026-03-28 11:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279
2026-03-28 11:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279
2026-03-28 11:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f510f9e-3b00-5b5c-83d4-63ca840c9e2d with identifier: UD17279 to the API
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:20:37Z',
 'fuel_type': 'diesel',
 'id': '1f510f9e-3b00-5b5c-83d4-63ca840c9e2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD17279',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 99043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-08',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2020}
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-28 11:11:07 [auto1.de] INFO: Saving data for UD17279: {'auction_closing_time': 1774714837.0, 'created_time': 1773688896.123319, 'last_price_update_time': 1774696267.885212}
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD17279') HTTP/1.1" 204 0
2026-03-28 11:11:07 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-28 11:11:07 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-28 11:11:07 [auto1.de] INFO: Scrape type for WU34060: 2
2026-03-28 11:11:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060
2026-03-28 11:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with scrape type 2
2026-03-28 11:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with scrape type 2
2026-03-28 11:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38, identifier: WU34060
2026-03-28 11:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060
2026-03-28 11:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060
2026-03-28 11:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fa9eeca-3502-5a6f-80ae-74520ebbbe38 with identifier: WU34060 to the API
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:36:18Z',
 'fuel_type': 'petrol',
 'id': '5fa9eeca-3502-5a6f-80ae-74520ebbbe38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU34060',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 201041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-28',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style Copa',
 'transmission': 'manual',
 'trim': 'Style Copa',
 'year': 2011}
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-28 11:11:08 [auto1.de] INFO: Saving data for WU34060: {'auction_closing_time': 1774715778.0, 'created_time': 1773812129.92023, 'last_price_update_time': 1774696268.308715}
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU34060') HTTP/1.1" 204 0
2026-03-28 11:11:08 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-28 11:11:08 [auto1.de] INFO: Scrape type for PC86421: 2
2026-03-28 11:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421
2026-03-28 11:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 651a4870-40ff-5f5b-bfb9-2faf21646919 with scrape type 2
2026-03-28 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 651a4870-40ff-5f5b-bfb9-2faf21646919 with scrape type 2
2026-03-28 11:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 651a4870-40ff-5f5b-bfb9-2faf21646919, identifier: PC86421
2026-03-28 11:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421
2026-03-28 11:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421
2026-03-28 11:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 651a4870-40ff-5f5b-bfb9-2faf21646919 with identifier: PC86421 to the API
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:58:27Z',
 'fuel_type': 'diesel',
 'id': '651a4870-40ff-5f5b-bfb9-2faf21646919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC86421',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 96002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-21',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L1H1 Ka 2,8t',
 'transmission': 'manual',
 'trim': 'L1H1 Ka 2,8t',
 'year': 2014}
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-28 11:11:08 [auto1.de] INFO: Saving data for PC86421: {'auction_closing_time': 1774717107.0, 'created_time': 1773304798.900836, 'last_price_update_time': 1774696268.730295}
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC86421') HTTP/1.1" 204 0
2026-03-28 11:11:08 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-28 11:11:08 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-28 11:11:08 [auto1.de] INFO: Scrape type for PT78073: 2
2026-03-28 11:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073
2026-03-28 11:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 595e6759-546d-5b7d-b185-268441999091 with scrape type 2
2026-03-28 11:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 595e6759-546d-5b7d-b185-268441999091 with scrape type 2
2026-03-28 11:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 595e6759-546d-5b7d-b185-268441999091, identifier: PT78073
2026-03-28 11:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073
2026-03-28 11:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073
2026-03-28 11:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 595e6759-546d-5b7d-b185-268441999091 with identifier: PT78073 to the API
2026-03-28 11:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:21:31Z',
 'fuel_type': 'petrol',
 'id': '595e6759-546d-5b7d-b185-268441999091',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT78073',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 32849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-11',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Ultimate',
 'transmission': 'automatic',
 'trim': 'Ultimate',
 'year': 2024}
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-28 11:11:09 [auto1.de] INFO: Saving data for PT78073: {'auction_closing_time': 1774714891.0, 'created_time': 1773305116.950431, 'last_price_update_time': 1774696269.159277}
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT78073') HTTP/1.1" 204 0
2026-03-28 11:11:09 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-28 11:11:09 [auto1.de] INFO: Scrape type for DT94754: 2
2026-03-28 11:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754
2026-03-28 11:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with scrape type 2
2026-03-28 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with scrape type 2
2026-03-28 11:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b47c6fe8-8101-57d4-9b05-3ca720aff3e2, identifier: DT94754
2026-03-28 11:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754
2026-03-28 11:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754
2026-03-28 11:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b47c6fe8-8101-57d4-9b05-3ca720aff3e2 with identifier: DT94754 to the API
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:50:51Z',
 'fuel_type': 'diesel',
 'id': 'b47c6fe8-8101-57d4-9b05-3ca720aff3e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT94754',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 98855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-20',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2014}
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-28 11:11:09 [auto1.de] INFO: Saving data for DT94754: {'auction_closing_time': 1774716651.0, 'created_time': 1773380560.023934, 'last_price_update_time': 1774696269.7053}
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT94754') HTTP/1.1" 204 0
2026-03-28 11:11:09 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-28 11:11:09 [auto1.de] INFO: Scrape type for MG70959: 2
2026-03-28 11:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959
2026-03-28 11:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with scrape type 2
2026-03-28 11:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with scrape type 2
2026-03-28 11:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82, identifier: MG70959
2026-03-28 11:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959
2026-03-28 11:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959
2026-03-28 11:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1650e1ec-9f27-5960-8d16-69c8bdbe0c82 with identifier: MG70959 to the API
2026-03-28 11:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:54:15Z',
 'fuel_type': 'petrol',
 'id': '1650e1ec-9f27-5960-8d16-69c8bdbe0c82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG70959',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 247311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-28 11:11:10 [auto1.de] INFO: Saving data for MG70959: {'auction_closing_time': 1774716855.0, 'created_time': 1773380530.636258, 'last_price_update_time': 1774696270.120105}
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG70959') HTTP/1.1" 204 0
2026-03-28 11:11:10 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-28 11:11:10 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-28 11:11:10 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-28 11:11:10 [auto1.de] INFO: Scrape type for AU40553: 2
2026-03-28 11:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553
2026-03-28 11:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9961705-a728-544e-be0f-bddba2cf9e3b with scrape type 2
2026-03-28 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9961705-a728-544e-be0f-bddba2cf9e3b with scrape type 2
2026-03-28 11:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9961705-a728-544e-be0f-bddba2cf9e3b, identifier: AU40553
2026-03-28 11:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553
2026-03-28 11:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553
2026-03-28 11:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9961705-a728-544e-be0f-bddba2cf9e3b with identifier: AU40553 to the API
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:19:16Z',
 'fuel_type': 'diesel',
 'id': 'e9961705-a728-544e-be0f-bddba2cf9e3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU40553',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Caravelle',
 'odometer': 198514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-31',
 'seller_name': None,
 'title': 'Volkswagen T5 Caravelle 2.0 TDI Trendline lang',
 'transmission': 'manual',
 'trim': 'Trendline lang',
 'year': 2011}
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-28 11:11:10 [auto1.de] INFO: Saving data for AU40553: {'auction_closing_time': 1774714756.0, 'created_time': 1773686168.732536, 'last_price_update_time': 1774696270.544284}
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU40553') HTTP/1.1" 204 0
2026-03-28 11:11:10 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-28 11:11:10 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-28 11:11:10 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-28 11:11:10 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-28 11:11:10 [auto1.de] INFO: Scrape type for ES68108: 2
2026-03-28 11:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108
2026-03-28 11:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with scrape type 2
2026-03-28 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with scrape type 2
2026-03-28 11:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1803ee4c-aab7-54d1-8d04-2628fd9e4694, identifier: ES68108
2026-03-28 11:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108
2026-03-28 11:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108
2026-03-28 11:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1803ee4c-aab7-54d1-8d04-2628fd9e4694 with identifier: ES68108 to the API
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:14:09Z',
 'fuel_type': 'diesel',
 'id': '1803ee4c-aab7-54d1-8d04-2628fd9e4694',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES68108',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 263130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-31',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Champions Edition',
 'transmission': 'automatic',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-28 11:11:10 [auto1.de] INFO: Saving data for ES68108: {'auction_closing_time': 1774714449.0, 'created_time': 1773775436.293137, 'last_price_update_time': 1774696270.947984}
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES68108') HTTP/1.1" 204 0
2026-03-28 11:11:10 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-28 11:11:10 [auto1.de] INFO: Scrape type for KZ08446: 2
2026-03-28 11:11:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446
2026-03-28 11:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0062780f-5834-5996-80a8-4cd62721e991 with scrape type 2
2026-03-28 11:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0062780f-5834-5996-80a8-4cd62721e991 with scrape type 2
2026-03-28 11:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0062780f-5834-5996-80a8-4cd62721e991, identifier: KZ08446
2026-03-28 11:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446
2026-03-28 11:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446
2026-03-28 11:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0062780f-5834-5996-80a8-4cd62721e991 with identifier: KZ08446 to the API
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:07Z',
 'fuel_type': 'petrol',
 'id': '0062780f-5834-5996-80a8-4cd62721e991',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ08446',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 85779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-28 11:11:11 [auto1.de] INFO: Saving data for KZ08446: {'auction_closing_time': 1774713727.0, 'created_time': 1774290938.902477, 'last_price_update_time': 1774696271.382423}
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ08446') HTTP/1.1" 204 0
2026-03-28 11:11:11 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-28 11:11:11 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-28 11:11:11 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-28 11:11:11 [auto1.de] INFO: Scrape type for VE16712: 2
2026-03-28 11:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712
2026-03-28 11:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with scrape type 2
2026-03-28 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with scrape type 2
2026-03-28 11:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5746afbe-8f5f-5d3c-90e8-a86f2a105410, identifier: VE16712
2026-03-28 11:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712
2026-03-28 11:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712
2026-03-28 11:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5746afbe-8f5f-5d3c-90e8-a86f2a105410 with identifier: VE16712 to the API
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:58Z',
 'fuel_type': 'petrol',
 'id': '5746afbe-8f5f-5d3c-90e8-a86f2a105410',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE16712',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 84759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2020}
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-28 11:11:11 [auto1.de] INFO: Saving data for VE16712: {'auction_closing_time': 1774716598.0, 'created_time': 1774290946.965932, 'last_price_update_time': 1774696271.779494}
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE16712') HTTP/1.1" 204 0
2026-03-28 11:11:11 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-28 11:11:11 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-28 11:11:11 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-28 11:11:11 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-28 11:11:11 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-28 11:11:11 [auto1.de] INFO: Scrape type for VZ83010: 2
2026-03-28 11:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010
2026-03-28 11:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bf64692-57e2-53f0-ad58-a325f2b580e1 with scrape type 2
2026-03-28 11:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bf64692-57e2-53f0-ad58-a325f2b580e1 with scrape type 2
2026-03-28 11:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bf64692-57e2-53f0-ad58-a325f2b580e1, identifier: VZ83010
2026-03-28 11:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010
2026-03-28 11:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010
2026-03-28 11:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bf64692-57e2-53f0-ad58-a325f2b580e1 with identifier: VZ83010 to the API
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:33Z',
 'fuel_type': 'petrol',
 'id': '0bf64692-57e2-53f0-ad58-a325f2b580e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ83010',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 38799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-05',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2024}
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-28 11:11:12 [auto1.de] INFO: Saving data for VZ83010: {'auction_closing_time': 1774715733.0, 'created_time': 1773402383.542394, 'last_price_update_time': 1774696272.279939}
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ83010') HTTP/1.1" 204 0
2026-03-28 11:11:12 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-28 11:11:12 [auto1.de] INFO: Scrape type for VG18386: 2
2026-03-28 11:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386
2026-03-28 11:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643bca71-1a1d-51e2-a493-9be2e8e07c32 with scrape type 2
2026-03-28 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643bca71-1a1d-51e2-a493-9be2e8e07c32 with scrape type 2
2026-03-28 11:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643bca71-1a1d-51e2-a493-9be2e8e07c32, identifier: VG18386
2026-03-28 11:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386
2026-03-28 11:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386
2026-03-28 11:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643bca71-1a1d-51e2-a493-9be2e8e07c32 with identifier: VG18386 to the API
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 420,
 'expiration_date': '2026-03-28T16:10:44Z',
 'fuel_type': 'petrol',
 'id': '643bca71-1a1d-51e2-a493-9be2e8e07c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG18386',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 135646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-19',
 'seller_name': None,
 'title': 'Porsche Panamera 4S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-28 11:11:12 [auto1.de] INFO: Saving data for VG18386: {'auction_closing_time': 1774714244.0, 'created_time': 1773773377.20829, 'last_price_update_time': 1774696272.692556}
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VG18386') HTTP/1.1" 204 0
2026-03-28 11:11:12 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-28 11:11:12 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-28 11:11:12 [auto1.de] INFO: Scrape type for XV53612: 2
2026-03-28 11:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612
2026-03-28 11:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d08b116-37b6-5019-9c84-dc6091f31c13 with scrape type 2
2026-03-28 11:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d08b116-37b6-5019-9c84-dc6091f31c13 with scrape type 2
2026-03-28 11:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d08b116-37b6-5019-9c84-dc6091f31c13, identifier: XV53612
2026-03-28 11:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612
2026-03-28 11:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612
2026-03-28 11:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d08b116-37b6-5019-9c84-dc6091f31c13 with identifier: XV53612 to the API
2026-03-28 11:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:21:36Z',
 'fuel_type': 'hybrid',
 'id': '1d08b116-37b6-5019-9c84-dc6091f31c13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV53612',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 59935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-19',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-28 11:11:13 [auto1.de] INFO: Saving data for XV53612: {'auction_closing_time': 1774714896.0, 'created_time': 1773400172.608221, 'last_price_update_time': 1774696273.124884}
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV53612') HTTP/1.1" 204 0
2026-03-28 11:11:13 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-28 11:11:13 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-28 11:11:13 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-28 11:11:13 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-28 11:11:13 [auto1.de] INFO: Scrape type for BC20634: 2
2026-03-28 11:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634
2026-03-28 11:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with scrape type 2
2026-03-28 11:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with scrape type 2
2026-03-28 11:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbf5abc8-4e5a-5d2f-9122-6cf33efca500, identifier: BC20634
2026-03-28 11:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634
2026-03-28 11:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634
2026-03-28 11:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbf5abc8-4e5a-5d2f-9122-6cf33efca500 with identifier: BC20634 to the API
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:09:46Z',
 'fuel_type': 'petrol',
 'id': 'dbf5abc8-4e5a-5d2f-9122-6cf33efca500',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC20634',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 68368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-14',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-28 11:11:13 [auto1.de] INFO: Saving data for BC20634: {'auction_closing_time': 1774714186.0, 'created_time': 1773302441.659356, 'last_price_update_time': 1774696273.515244}
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC20634') HTTP/1.1" 204 0
2026-03-28 11:11:13 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-28 11:11:13 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-28 11:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:11:40 [auto1.de] INFO: Channel: 24h | Page: 221 | totalHits: 9709 | hits on page: 40
2026-03-28 11:11:40 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-28 11:11:40 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-28 11:11:40 [auto1.de] INFO: Scrape type for HY33546: 2
2026-03-28 11:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546
2026-03-28 11:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d11637e-f70c-5c62-8b36-ea3a54712054 with scrape type 2
2026-03-28 11:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d11637e-f70c-5c62-8b36-ea3a54712054 with scrape type 2
2026-03-28 11:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d11637e-f70c-5c62-8b36-ea3a54712054, identifier: HY33546
2026-03-28 11:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546
2026-03-28 11:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546
2026-03-28 11:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d11637e-f70c-5c62-8b36-ea3a54712054 with identifier: HY33546 to the API
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:55:14Z',
 'fuel_type': 'diesel',
 'id': '1d11637e-f70c-5c62-8b36-ea3a54712054',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY33546',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 308129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-14',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Startline',
 'transmission': 'manual',
 'trim': 'Startline',
 'year': 2010}
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-28 11:11:40 [auto1.de] INFO: Saving data for HY33546: {'auction_closing_time': 1774716914.0, 'created_time': 1773858962.114718, 'last_price_update_time': 1774696300.544539}
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY33546') HTTP/1.1" 204 0
2026-03-28 11:11:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:11:40 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-28 11:11:40 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-28 11:11:40 [auto1.de] INFO: Scrape type for MM42204: 2
2026-03-28 11:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204
2026-03-28 11:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ac0a31-65f1-55fc-9702-6098d4b16fee with scrape type 2
2026-03-28 11:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80ac0a31-65f1-55fc-9702-6098d4b16fee with scrape type 2
2026-03-28 11:11:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80ac0a31-65f1-55fc-9702-6098d4b16fee, identifier: MM42204
2026-03-28 11:11:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204
2026-03-28 11:11:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204
2026-03-28 11:11:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80ac0a31-65f1-55fc-9702-6098d4b16fee with identifier: MM42204 to the API
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:42:36Z',
 'fuel_type': 'diesel',
 'id': '80ac0a31-65f1-55fc-9702-6098d4b16fee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM42204',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 194390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-10',
 'seller_name': None,
 'title': 'BMW 3er 325d GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-28 11:11:40 [auto1.de] INFO: Saving data for MM42204: {'auction_closing_time': 1774716156.0, 'created_time': 1773302884.786969, 'last_price_update_time': 1774696300.963503}
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM42204') HTTP/1.1" 204 0
2026-03-28 11:11:40 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-28 11:11:40 [auto1.de] INFO: Scrape type for MK56575: 2
2026-03-28 11:11:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575
2026-03-28 11:11:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with scrape type 2
2026-03-28 11:11:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with scrape type 2
2026-03-28 11:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c, identifier: MK56575
2026-03-28 11:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575
2026-03-28 11:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575
2026-03-28 11:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77c88eb5-6b21-5377-9ddb-6ab76c7b326c with identifier: MK56575 to the API
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:22:56Z',
 'fuel_type': 'petrol',
 'id': '77c88eb5-6b21-5377-9ddb-6ab76c7b326c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK56575',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 43203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2021}
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-28 11:11:41 [auto1.de] INFO: Saving data for MK56575: {'auction_closing_time': 1774714976.0, 'created_time': 1774293595.117582, 'last_price_update_time': 1774696301.385425}
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK56575') HTTP/1.1" 204 0
2026-03-28 11:11:41 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-28 11:11:41 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-28 11:11:41 [auto1.de] INFO: Scrape type for XC92552: 2
2026-03-28 11:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552
2026-03-28 11:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 033e6181-c47b-5fc7-a64e-6e4a05601912 with scrape type 2
2026-03-28 11:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 033e6181-c47b-5fc7-a64e-6e4a05601912 with scrape type 2
2026-03-28 11:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 033e6181-c47b-5fc7-a64e-6e4a05601912, identifier: XC92552
2026-03-28 11:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552
2026-03-28 11:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552
2026-03-28 11:11:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 033e6181-c47b-5fc7-a64e-6e4a05601912 with identifier: XC92552 to the API
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:37Z',
 'fuel_type': 'petrol',
 'id': '033e6181-c47b-5fc7-a64e-6e4a05601912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC92552',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 246270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seller_name': None,
 'title': 'Subaru XV 2.0 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2018}
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-28 11:11:41 [auto1.de] INFO: Saving data for XC92552: {'auction_closing_time': 1774715077.0, 'created_time': 1773383044.674937, 'last_price_update_time': 1774696301.79757}
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC92552') HTTP/1.1" 204 0
2026-03-28 11:11:41 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-28 11:11:41 [auto1.de] INFO: Scrape type for WT06361: 2
2026-03-28 11:11:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361
2026-03-28 11:11:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edc68f7b-d13b-59da-806a-9ec51780cac0 with scrape type 2
2026-03-28 11:11:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edc68f7b-d13b-59da-806a-9ec51780cac0 with scrape type 2
2026-03-28 11:11:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edc68f7b-d13b-59da-806a-9ec51780cac0, identifier: WT06361
2026-03-28 11:11:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361
2026-03-28 11:11:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361
2026-03-28 11:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edc68f7b-d13b-59da-806a-9ec51780cac0 with identifier: WT06361 to the API
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:09:15Z',
 'fuel_type': 'petrol',
 'id': 'edc68f7b-d13b-59da-806a-9ec51780cac0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT06361',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 82581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-25',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Si',
 'transmission': 'manual',
 'trim': 'Si',
 'year': 2013}
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-28 11:11:42 [auto1.de] INFO: Saving data for WT06361: {'auction_closing_time': 1774714155.0, 'created_time': 1774294840.7253, 'last_price_update_time': 1774696302.195194}
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT06361') HTTP/1.1" 204 0
2026-03-28 11:11:42 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-28 11:11:42 [auto1.de] INFO: Scrape type for MG94250: 2
2026-03-28 11:11:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250
2026-03-28 11:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with scrape type 2
2026-03-28 11:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with scrape type 2
2026-03-28 11:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bc1cd76-52db-5e6c-9536-fd3ed2009216, identifier: MG94250
2026-03-28 11:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250
2026-03-28 11:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250
2026-03-28 11:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bc1cd76-52db-5e6c-9536-fd3ed2009216 with identifier: MG94250 to the API
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-28T16:29:38Z',
 'fuel_type': 'petrol',
 'id': '6bc1cd76-52db-5e6c-9536-fd3ed2009216',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG94250',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 183656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-26',
 'seller_name': None,
 'title': 'Citroen C3 1.4 VTR',
 'transmission': 'manual',
 'trim': 'VTR',
 'year': 2007}
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-28 11:11:42 [auto1.de] INFO: Saving data for MG94250: {'auction_closing_time': 1774715378.0, 'created_time': 1773812139.32712, 'last_price_update_time': 1774696302.617467}
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG94250') HTTP/1.1" 204 0
2026-03-28 11:11:42 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-28 11:11:42 [auto1.de] INFO: Scrape type for BU63404: 2
2026-03-28 11:11:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404
2026-03-28 11:11:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f9a921-65a4-5460-b3b7-5b841dd57e39 with scrape type 2
2026-03-28 11:11:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f9a921-65a4-5460-b3b7-5b841dd57e39 with scrape type 2
2026-03-28 11:11:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7f9a921-65a4-5460-b3b7-5b841dd57e39, identifier: BU63404
2026-03-28 11:11:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404
2026-03-28 11:11:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404
2026-03-28 11:11:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7f9a921-65a4-5460-b3b7-5b841dd57e39 with identifier: BU63404 to the API
2026-03-28 11:11:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:17:54Z',
 'fuel_type': 'diesel',
 'id': 'c7f9a921-65a4-5460-b3b7-5b841dd57e39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU63404',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 59284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-29',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TDI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2023}
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-28 11:11:43 [auto1.de] INFO: Saving data for BU63404: {'auction_closing_time': 1774714674.0, 'created_time': 1773380713.034147, 'last_price_update_time': 1774696303.149766}
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU63404') HTTP/1.1" 204 0
2026-03-28 11:11:43 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-28 11:11:43 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-28 11:11:43 [auto1.de] INFO: Scrape type for AR51863: 2
2026-03-28 11:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863
2026-03-28 11:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca696def-5809-59c0-9ae7-b3c41456be99 with scrape type 2
2026-03-28 11:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca696def-5809-59c0-9ae7-b3c41456be99 with scrape type 2
2026-03-28 11:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca696def-5809-59c0-9ae7-b3c41456be99, identifier: AR51863
2026-03-28 11:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863
2026-03-28 11:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863
2026-03-28 11:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca696def-5809-59c0-9ae7-b3c41456be99 with identifier: AR51863 to the API
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:14:54Z',
 'fuel_type': 'petrol',
 'id': 'ca696def-5809-59c0-9ae7-b3c41456be99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR51863',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 81673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-28 11:11:43 [auto1.de] INFO: Saving data for AR51863: {'auction_closing_time': 1774714494.0, 'created_time': 1773303654.201246, 'last_price_update_time': 1774696303.550752}
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR51863') HTTP/1.1" 204 0
2026-03-28 11:11:43 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-28 11:11:43 [auto1.de] INFO: Scrape type for PR96123: 2
2026-03-28 11:11:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123
2026-03-28 11:11:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a7e94c-3b2b-5aee-9380-d9926191415f with scrape type 2
2026-03-28 11:11:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13a7e94c-3b2b-5aee-9380-d9926191415f with scrape type 2
2026-03-28 11:11:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13a7e94c-3b2b-5aee-9380-d9926191415f, identifier: PR96123
2026-03-28 11:11:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123
2026-03-28 11:11:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123
2026-03-28 11:11:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13a7e94c-3b2b-5aee-9380-d9926191415f with identifier: PR96123 to the API
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:03:15Z',
 'fuel_type': 'diesel',
 'id': '13a7e94c-3b2b-5aee-9380-d9926191415f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR96123',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 158464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-19',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2016}
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-28 11:11:43 [auto1.de] INFO: Saving data for PR96123: {'auction_closing_time': 1774713795.0, 'created_time': 1773305144.233712, 'last_price_update_time': 1774696303.971692}
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR96123') HTTP/1.1" 204 0
2026-03-28 11:11:43 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-28 11:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-28 11:11:44 [auto1.de] INFO: Scrape type for GE71981: 2
2026-03-28 11:11:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981
2026-03-28 11:11:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343a34c2-cb4d-5c02-a9c5-767603466e49 with scrape type 2
2026-03-28 11:11:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 343a34c2-cb4d-5c02-a9c5-767603466e49 with scrape type 2
2026-03-28 11:11:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 343a34c2-cb4d-5c02-a9c5-767603466e49, identifier: GE71981
2026-03-28 11:11:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981
2026-03-28 11:11:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981
2026-03-28 11:11:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 343a34c2-cb4d-5c02-a9c5-767603466e49 with identifier: GE71981 to the API
2026-03-28 11:11:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:29:32Z',
 'fuel_type': 'petrol',
 'id': '343a34c2-cb4d-5c02-a9c5-767603466e49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE71981',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 110771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.6 LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2012}
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-28 11:11:45 [auto1.de] INFO: Saving data for GE71981: {'auction_closing_time': 1774715372.0, 'created_time': 1773775126.334973, 'last_price_update_time': 1774696305.196528}
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE71981') HTTP/1.1" 204 0
2026-03-28 11:11:45 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-28 11:11:45 [auto1.de] INFO: Scrape type for ZH23061: 2
2026-03-28 11:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061
2026-03-28 11:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f3806d3-11d9-55f2-a90b-90c31941c829 with scrape type 2
2026-03-28 11:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f3806d3-11d9-55f2-a90b-90c31941c829 with scrape type 2
2026-03-28 11:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f3806d3-11d9-55f2-a90b-90c31941c829, identifier: ZH23061
2026-03-28 11:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061
2026-03-28 11:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061
2026-03-28 11:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f3806d3-11d9-55f2-a90b-90c31941c829 with identifier: ZH23061 to the API
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:26:22Z',
 'fuel_type': 'petrol',
 'id': '4f3806d3-11d9-55f2-a90b-90c31941c829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH23061',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 96501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2018}
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-28 11:11:45 [auto1.de] INFO: Saving data for ZH23061: {'auction_closing_time': 1774715182.0, 'created_time': 1773861498.344512, 'last_price_update_time': 1774696305.613495}
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH23061') HTTP/1.1" 204 0
2026-03-28 11:11:45 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-28 11:11:45 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-28 11:11:45 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-28 11:11:45 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-28 11:11:45 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-28 11:11:45 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-28 11:11:45 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-28 11:11:45 [auto1.de] INFO: Scrape type for TW39351: 2
2026-03-28 11:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351
2026-03-28 11:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2958a98a-3664-5621-b54a-e8414dc4dbc4 with scrape type 2
2026-03-28 11:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2958a98a-3664-5621-b54a-e8414dc4dbc4 with scrape type 2
2026-03-28 11:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2958a98a-3664-5621-b54a-e8414dc4dbc4, identifier: TW39351
2026-03-28 11:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351
2026-03-28 11:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351
2026-03-28 11:11:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2958a98a-3664-5621-b54a-e8414dc4dbc4 with identifier: TW39351 to the API
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:38:31Z',
 'fuel_type': 'petrol',
 'id': '2958a98a-3664-5621-b54a-e8414dc4dbc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW39351',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 167602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-07',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-28 11:11:46 [auto1.de] INFO: Saving data for TW39351: {'auction_closing_time': 1774715911.0, 'created_time': 1773383295.376422, 'last_price_update_time': 1774696306.023043}
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW39351') HTTP/1.1" 204 0
2026-03-28 11:11:46 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-28 11:11:46 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-28 11:11:46 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-28 11:11:46 [auto1.de] INFO: Scrape type for VK44645: 2
2026-03-28 11:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645
2026-03-28 11:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa00de5f-a712-5d33-8d4e-b317246fa97a with scrape type 2
2026-03-28 11:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa00de5f-a712-5d33-8d4e-b317246fa97a with scrape type 2
2026-03-28 11:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa00de5f-a712-5d33-8d4e-b317246fa97a, identifier: VK44645
2026-03-28 11:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645
2026-03-28 11:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645
2026-03-28 11:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa00de5f-a712-5d33-8d4e-b317246fa97a with identifier: VK44645 to the API
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:56:01Z',
 'fuel_type': 'petrol',
 'id': 'fa00de5f-a712-5d33-8d4e-b317246fa97a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK44645',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 199651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-27',
 'seller_name': None,
 'title': 'BMW 4er 440i Gran Coupé xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2017}
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-28 11:11:46 [auto1.de] INFO: Saving data for VK44645: {'auction_closing_time': 1774716961.0, 'created_time': 1773686725.472849, 'last_price_update_time': 1774696306.567351}
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK44645') HTTP/1.1" 204 0
2026-03-28 11:11:46 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-28 11:11:46 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-28 11:11:46 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-28 11:11:46 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-28 11:11:46 [auto1.de] INFO: Scrape type for AE67956: 2
2026-03-28 11:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956
2026-03-28 11:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73b37455-c58b-5a18-9e16-099c2dd454f2 with scrape type 2
2026-03-28 11:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73b37455-c58b-5a18-9e16-099c2dd454f2 with scrape type 2
2026-03-28 11:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73b37455-c58b-5a18-9e16-099c2dd454f2, identifier: AE67956
2026-03-28 11:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956
2026-03-28 11:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956
2026-03-28 11:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73b37455-c58b-5a18-9e16-099c2dd454f2 with identifier: AE67956 to the API
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:04:21Z',
 'fuel_type': 'petrol',
 'id': '73b37455-c58b-5a18-9e16-099c2dd454f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE67956',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 140187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-28 11:11:46 [auto1.de] INFO: Saving data for AE67956: {'auction_closing_time': 1774713861.0, 'created_time': 1774263628.220745, 'last_price_update_time': 1774696306.976522}
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE67956') HTTP/1.1" 204 0
2026-03-28 11:11:46 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-28 11:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-28 11:11:47 [auto1.de] INFO: Scrape type for KD49468: 2
2026-03-28 11:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468
2026-03-28 11:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 491f0b8c-14be-5293-9969-448106eac0c7 with scrape type 2
2026-03-28 11:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 491f0b8c-14be-5293-9969-448106eac0c7 with scrape type 2
2026-03-28 11:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 491f0b8c-14be-5293-9969-448106eac0c7, identifier: KD49468
2026-03-28 11:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468
2026-03-28 11:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468
2026-03-28 11:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 491f0b8c-14be-5293-9969-448106eac0c7 with identifier: KD49468 to the API
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:20:39Z',
 'fuel_type': 'petrol',
 'id': '491f0b8c-14be-5293-9969-448106eac0c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD49468',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 98321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-28',
 'seller_name': None,
 'title': 'Renault Espace 1.8 TCe Energy Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2018}
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-28 11:11:47 [auto1.de] INFO: Saving data for KD49468: {'auction_closing_time': 1774714839.0, 'created_time': 1774292315.787011, 'last_price_update_time': 1774696307.377242}
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD49468') HTTP/1.1" 204 0
2026-03-28 11:11:47 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-28 11:11:47 [auto1.de] INFO: Scrape type for SA11985: 2
2026-03-28 11:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985
2026-03-28 11:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e5519d6-1eef-5901-b84b-152399c15e72 with scrape type 2
2026-03-28 11:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e5519d6-1eef-5901-b84b-152399c15e72 with scrape type 2
2026-03-28 11:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e5519d6-1eef-5901-b84b-152399c15e72, identifier: SA11985
2026-03-28 11:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985
2026-03-28 11:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985
2026-03-28 11:11:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e5519d6-1eef-5901-b84b-152399c15e72 with identifier: SA11985 to the API
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:45:55Z',
 'fuel_type': 'petrol',
 'id': '1e5519d6-1eef-5901-b84b-152399c15e72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA11985',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 159416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-14',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.0 TSI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2017}
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-28 11:11:47 [auto1.de] INFO: Saving data for SA11985: {'auction_closing_time': 1774716355.0, 'created_time': 1773306558.875126, 'last_price_update_time': 1774696307.781742}
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA11985') HTTP/1.1" 204 0
2026-03-28 11:11:47 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-28 11:11:47 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-28 11:11:47 [auto1.de] INFO: Scrape type for PH00058: 2
2026-03-28 11:11:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058
2026-03-28 11:11:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a46500ce-d342-50d1-bab5-1adf103992a9 with scrape type 2
2026-03-28 11:11:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a46500ce-d342-50d1-bab5-1adf103992a9 with scrape type 2
2026-03-28 11:11:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a46500ce-d342-50d1-bab5-1adf103992a9, identifier: PH00058
2026-03-28 11:11:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058
2026-03-28 11:11:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058
2026-03-28 11:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a46500ce-d342-50d1-bab5-1adf103992a9 with identifier: PH00058 to the API
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:02:30Z',
 'fuel_type': 'petrol',
 'id': 'a46500ce-d342-50d1-bab5-1adf103992a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH00058',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 134647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turbo Quadrifoglio Verde',
 'transmission': 'manual',
 'trim': 'Quadrifoglio Verde',
 'year': 2015}
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-28 11:11:48 [auto1.de] INFO: Saving data for PH00058: {'auction_closing_time': 1774713750.0, 'created_time': 1773305456.289794, 'last_price_update_time': 1774696308.231454}
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH00058') HTTP/1.1" 204 0
2026-03-28 11:11:48 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-28 11:11:48 [auto1.de] INFO: Scrape type for MJ48017: 2
2026-03-28 11:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017
2026-03-28 11:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with scrape type 2
2026-03-28 11:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with scrape type 2
2026-03-28 11:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3, identifier: MJ48017
2026-03-28 11:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017
2026-03-28 11:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017
2026-03-28 11:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3 with identifier: MJ48017 to the API
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:29:42Z',
 'fuel_type': 'petrol',
 'id': 'c5bcc8f8-0c02-5893-ac58-06b0bbb20ff3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ48017',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'XCeed',
 'odometer': 58100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-07',
 'seller_name': None,
 'title': 'Kia XCeed 1.5 TGDI Xdition',
 'transmission': 'automatic',
 'trim': 'Xdition',
 'year': 2021}
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-28 11:11:48 [auto1.de] INFO: Saving data for MJ48017: {'auction_closing_time': 1774715382.0, 'created_time': 1773304914.987203, 'last_price_update_time': 1774696308.752473}
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ48017') HTTP/1.1" 204 0
2026-03-28 11:11:48 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-28 11:11:48 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-28 11:11:48 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-28 11:11:48 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-28 11:11:48 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-28 11:11:48 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-28 11:11:48 [auto1.de] INFO: Channel: 24h | Page: 222 | totalHits: 9709 | hits on page: 40
2026-03-28 11:11:48 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-28 11:11:48 [auto1.de] INFO: Scrape type for HH04622: 2
2026-03-28 11:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622
2026-03-28 11:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1073c23e-5468-5ddc-aeec-3344b9e071b0 with scrape type 2
2026-03-28 11:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1073c23e-5468-5ddc-aeec-3344b9e071b0 with scrape type 2
2026-03-28 11:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1073c23e-5468-5ddc-aeec-3344b9e071b0, identifier: HH04622
2026-03-28 11:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622
2026-03-28 11:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622
2026-03-28 11:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1073c23e-5468-5ddc-aeec-3344b9e071b0 with identifier: HH04622 to the API
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:42:52Z',
 'fuel_type': 'petrol',
 'id': '1073c23e-5468-5ddc-aeec-3344b9e071b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH04622',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 231255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-28',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-28 11:11:49 [auto1.de] INFO: Saving data for HH04622: {'auction_closing_time': 1774716172.0, 'created_time': 1773302806.650967, 'last_price_update_time': 1774696309.298754}
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH04622') HTTP/1.1" 204 0
2026-03-28 11:11:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:11:49 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-28 11:11:49 [auto1.de] INFO: Found listing with ID: DC16754
2026-03-28 11:11:49 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-28 11:11:49 [auto1.de] INFO: Scrape type for VU47138: 2
2026-03-28 11:11:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138
2026-03-28 11:11:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27b95a58-3d44-502c-b3c8-f522845bd629 with scrape type 2
2026-03-28 11:11:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27b95a58-3d44-502c-b3c8-f522845bd629 with scrape type 2
2026-03-28 11:11:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27b95a58-3d44-502c-b3c8-f522845bd629, identifier: VU47138
2026-03-28 11:11:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138
2026-03-28 11:11:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138
2026-03-28 11:11:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27b95a58-3d44-502c-b3c8-f522845bd629 with identifier: VU47138 to the API
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:53:15Z',
 'fuel_type': 'diesel',
 'id': '27b95a58-3d44-502c-b3c8-f522845bd629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU47138',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 304026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-07',
 'seller_name': None,
 'title': 'BMW X5 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-28 11:11:50 [auto1.de] INFO: Saving data for VU47138: {'auction_closing_time': 1774716795.0, 'created_time': 1774262994.748112, 'last_price_update_time': 1774696310.066856}
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU47138') HTTP/1.1" 204 0
2026-03-28 11:11:50 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-28 11:11:50 [auto1.de] INFO: Scrape type for XV26734: 2
2026-03-28 11:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734
2026-03-28 11:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26b12246-b8ea-50fa-bd53-3d1639e4893d with scrape type 2
2026-03-28 11:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26b12246-b8ea-50fa-bd53-3d1639e4893d with scrape type 2
2026-03-28 11:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26b12246-b8ea-50fa-bd53-3d1639e4893d, identifier: XV26734
2026-03-28 11:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734
2026-03-28 11:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734
2026-03-28 11:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26b12246-b8ea-50fa-bd53-3d1639e4893d with identifier: XV26734 to the API
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:22:49Z',
 'fuel_type': 'diesel',
 'id': '26b12246-b8ea-50fa-bd53-3d1639e4893d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV26734',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 167830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI X-Perience 4Drive',
 'transmission': 'automatic',
 'trim': 'X-Perience 4Drive',
 'year': 2016}
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-28 11:11:50 [auto1.de] INFO: Saving data for XV26734: {'auction_closing_time': 1774714969.0, 'created_time': 1773304377.066621, 'last_price_update_time': 1774696310.671667}
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV26734') HTTP/1.1" 204 0
2026-03-28 11:11:50 [auto1.de] INFO: Found listing with ID: PE37736
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE37736%27 HTTP/1.1" 200 None
2026-03-28 11:11:50 [auto1.de] INFO: Scrape type for PE37736: 2
2026-03-28 11:11:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6953ed59-abdd-5f0d-896d-f4c10adc917a with identifier: PE37736
2026-03-28 11:11:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6953ed59-abdd-5f0d-896d-f4c10adc917a with scrape type 2
2026-03-28 11:11:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6953ed59-abdd-5f0d-896d-f4c10adc917a with scrape type 2
2026-03-28 11:11:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6953ed59-abdd-5f0d-896d-f4c10adc917a, identifier: PE37736
2026-03-28 11:11:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6953ed59-abdd-5f0d-896d-f4c10adc917a with identifier: PE37736
2026-03-28 11:11:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6953ed59-abdd-5f0d-896d-f4c10adc917a with identifier: PE37736
2026-03-28 11:11:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6953ed59-abdd-5f0d-896d-f4c10adc917a with identifier: PE37736 to the API
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:01:37Z',
 'fuel_type': 'diesel',
 'id': '6953ed59-abdd-5f0d-896d-f4c10adc917a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE37736',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 270454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-20',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2013}
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE37736%27 HTTP/1.1" 200 None
2026-03-28 11:11:51 [auto1.de] INFO: Saving data for PE37736: {'auction_closing_time': 1774713697.0, 'created_time': 1774608347.184119, 'last_price_update_time': 1774696311.052708}
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE37736') HTTP/1.1" 204 0
2026-03-28 11:11:51 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-28 11:11:51 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-28 11:11:51 [auto1.de] INFO: Scrape type for JN95479: 2
2026-03-28 11:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479
2026-03-28 11:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed611637-6328-5e3c-bfde-f589840b163a with scrape type 2
2026-03-28 11:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed611637-6328-5e3c-bfde-f589840b163a with scrape type 2
2026-03-28 11:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed611637-6328-5e3c-bfde-f589840b163a, identifier: JN95479
2026-03-28 11:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479
2026-03-28 11:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479
2026-03-28 11:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed611637-6328-5e3c-bfde-f589840b163a with identifier: JN95479 to the API
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:50:59Z',
 'fuel_type': 'diesel',
 'id': 'ed611637-6328-5e3c-bfde-f589840b163a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN95479',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-28 11:11:51 [auto1.de] INFO: Saving data for JN95479: {'auction_closing_time': 1774716659.0, 'created_time': 1773136001.187482, 'last_price_update_time': 1774696311.498402}
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN95479') HTTP/1.1" 204 0
2026-03-28 11:11:51 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-28 11:11:51 [auto1.de] INFO: Scrape type for FZ44442: 2
2026-03-28 11:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442
2026-03-28 11:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with scrape type 2
2026-03-28 11:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with scrape type 2
2026-03-28 11:11:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3, identifier: FZ44442
2026-03-28 11:11:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442
2026-03-28 11:11:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442
2026-03-28 11:11:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6f94a17-29e2-52f3-b9aa-487f9aeff4a3 with identifier: FZ44442 to the API
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:28:09Z',
 'fuel_type': 'hybrid',
 'id': 'b6f94a17-29e2-52f3-b9aa-487f9aeff4a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ44442',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 147599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-28 11:11:51 [auto1.de] INFO: Saving data for FZ44442: {'auction_closing_time': 1774715289.0, 'created_time': 1773230339.703605, 'last_price_update_time': 1774696311.92217}
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ44442') HTTP/1.1" 204 0
2026-03-28 11:11:51 [auto1.de] INFO: Found listing with ID: YM75197
2026-03-28 11:11:51 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-28 11:11:51 [auto1.de] INFO: Scrape type for KZ05104: 2
2026-03-28 11:11:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104
2026-03-28 11:11:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 518a77ff-2195-5e0d-9084-09893dfa3bad with scrape type 2
2026-03-28 11:11:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 518a77ff-2195-5e0d-9084-09893dfa3bad with scrape type 2
2026-03-28 11:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 518a77ff-2195-5e0d-9084-09893dfa3bad, identifier: KZ05104
2026-03-28 11:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104
2026-03-28 11:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104
2026-03-28 11:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 518a77ff-2195-5e0d-9084-09893dfa3bad with identifier: KZ05104 to the API
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:16:20Z',
 'fuel_type': 'petrol',
 'id': '518a77ff-2195-5e0d-9084-09893dfa3bad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ05104',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 91783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2012}
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-28 11:11:52 [auto1.de] INFO: Saving data for KZ05104: {'auction_closing_time': 1774714580.0, 'created_time': 1773772606.582612, 'last_price_update_time': 1774696312.35655}
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ05104') HTTP/1.1" 204 0
2026-03-28 11:11:52 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-28 11:11:52 [auto1.de] INFO: Scrape type for MJ96775: 2
2026-03-28 11:11:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775
2026-03-28 11:11:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d185de4-05a5-57c4-b388-b5a20e358d07 with scrape type 2
2026-03-28 11:11:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d185de4-05a5-57c4-b388-b5a20e358d07 with scrape type 2
2026-03-28 11:11:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d185de4-05a5-57c4-b388-b5a20e358d07, identifier: MJ96775
2026-03-28 11:11:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775
2026-03-28 11:11:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775
2026-03-28 11:11:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d185de4-05a5-57c4-b388-b5a20e358d07 with identifier: MJ96775 to the API
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:00:45Z',
 'fuel_type': 'petrol',
 'id': '0d185de4-05a5-57c4-b388-b5a20e358d07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ96775',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 143345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-17',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-28 11:11:53 [auto1.de] INFO: Saving data for MJ96775: {'auction_closing_time': 1774713645.0, 'created_time': 1773383441.76919, 'last_price_update_time': 1774696313.068409}
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ96775') HTTP/1.1" 204 0
2026-03-28 11:11:53 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-28 11:11:53 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-28 11:11:53 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-28 11:11:53 [auto1.de] INFO: Scrape type for SP67485: 2
2026-03-28 11:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485
2026-03-28 11:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45631848-20ed-5365-8783-d18efe639f58 with scrape type 2
2026-03-28 11:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45631848-20ed-5365-8783-d18efe639f58 with scrape type 2
2026-03-28 11:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45631848-20ed-5365-8783-d18efe639f58, identifier: SP67485
2026-03-28 11:11:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485
2026-03-28 11:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485
2026-03-28 11:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45631848-20ed-5365-8783-d18efe639f58 with identifier: SP67485 to the API
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:11:42Z',
 'fuel_type': 'diesel',
 'id': '45631848-20ed-5365-8783-d18efe639f58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP67485',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 196606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-28',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2008}
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-28 11:11:53 [auto1.de] INFO: Saving data for SP67485: {'auction_closing_time': 1774714302.0, 'created_time': 1773301971.904257, 'last_price_update_time': 1774696313.533553}
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP67485') HTTP/1.1" 204 0
2026-03-28 11:11:53 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-28 11:11:53 [auto1.de] INFO: Found listing with ID: TK73674
2026-03-28 11:11:53 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-28 11:11:53 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-28 11:11:53 [auto1.de] INFO: Scrape type for BA65327: 2
2026-03-28 11:11:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327
2026-03-28 11:11:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08039476-1e58-55bc-a729-5d8e6e59965d with scrape type 2
2026-03-28 11:11:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08039476-1e58-55bc-a729-5d8e6e59965d with scrape type 2
2026-03-28 11:11:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08039476-1e58-55bc-a729-5d8e6e59965d, identifier: BA65327
2026-03-28 11:11:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327
2026-03-28 11:11:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327
2026-03-28 11:11:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08039476-1e58-55bc-a729-5d8e6e59965d with identifier: BA65327 to the API
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:54:54Z',
 'fuel_type': 'petrol',
 'id': '08039476-1e58-55bc-a729-5d8e6e59965d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA65327',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 326138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-28 11:11:54 [auto1.de] INFO: Saving data for BA65327: {'auction_closing_time': 1774716894.0, 'created_time': 1773861427.078271, 'last_price_update_time': 1774696314.074617}
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA65327') HTTP/1.1" 204 0
2026-03-28 11:11:54 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-28 11:11:54 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-28 11:11:54 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-28 11:11:54 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-28 11:11:54 [auto1.de] INFO: Scrape type for XV50981: 2
2026-03-28 11:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981
2026-03-28 11:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875fc7cd-07f1-5628-bb84-dba208d6172d with scrape type 2
2026-03-28 11:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875fc7cd-07f1-5628-bb84-dba208d6172d with scrape type 2
2026-03-28 11:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875fc7cd-07f1-5628-bb84-dba208d6172d, identifier: XV50981
2026-03-28 11:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981
2026-03-28 11:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981
2026-03-28 11:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875fc7cd-07f1-5628-bb84-dba208d6172d with identifier: XV50981 to the API
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:19:48Z',
 'fuel_type': 'petrol',
 'id': '875fc7cd-07f1-5628-bb84-dba208d6172d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV50981',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 111249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-26',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-28 11:11:54 [auto1.de] INFO: Saving data for XV50981: {'auction_closing_time': 1774714788.0, 'created_time': 1773688241.402181, 'last_price_update_time': 1774696314.525955}
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV50981') HTTP/1.1" 204 0
2026-03-28 11:11:54 [auto1.de] INFO: Channel: 24h | Page: 223 | totalHits: 9709 | hits on page: 40
2026-03-28 11:11:54 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-28 11:11:54 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-28 11:11:54 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-28 11:11:54 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-28 11:11:54 [auto1.de] INFO: Scrape type for JK50656: 2
2026-03-28 11:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656
2026-03-28 11:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 352a306b-7d24-5f93-8abf-09acf74faf31 with scrape type 2
2026-03-28 11:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 352a306b-7d24-5f93-8abf-09acf74faf31 with scrape type 2
2026-03-28 11:11:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 352a306b-7d24-5f93-8abf-09acf74faf31, identifier: JK50656
2026-03-28 11:11:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656
2026-03-28 11:11:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656
2026-03-28 11:11:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 352a306b-7d24-5f93-8abf-09acf74faf31 with identifier: JK50656 to the API
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:06:16Z',
 'fuel_type': 'diesel',
 'id': '352a306b-7d24-5f93-8abf-09acf74faf31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK50656',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 232981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-28 11:11:54 [auto1.de] INFO: Saving data for JK50656: {'auction_closing_time': 1774713976.0, 'created_time': 1774251382.582754, 'last_price_update_time': 1774696314.916809}
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK50656') HTTP/1.1" 204 0
2026-03-28 11:11:55 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-28 11:11:55 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-28 11:11:55 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-28 11:11:55 [auto1.de] INFO: Scrape type for LS92843: 2
2026-03-28 11:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843
2026-03-28 11:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f772a1-8beb-5539-9ca4-503036589778 with scrape type 2
2026-03-28 11:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23f772a1-8beb-5539-9ca4-503036589778 with scrape type 2
2026-03-28 11:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23f772a1-8beb-5539-9ca4-503036589778, identifier: LS92843
2026-03-28 11:11:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:11:55 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-28 11:11:55 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-28 11:11:55 [auto1.de] INFO: Scrape type for ZL89473: 2
2026-03-28 11:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473
2026-03-28 11:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 429368c5-16de-5572-8779-c6f458c850bd with scrape type 2
2026-03-28 11:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 429368c5-16de-5572-8779-c6f458c850bd with scrape type 2
2026-03-28 11:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 429368c5-16de-5572-8779-c6f458c850bd, identifier: ZL89473
2026-03-28 11:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843
2026-03-28 11:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843
2026-03-28 11:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23f772a1-8beb-5539-9ca4-503036589778 with identifier: LS92843 to the API
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:01:26Z',
 'fuel_type': 'petrol',
 'id': '23f772a1-8beb-5539-9ca4-503036589778',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS92843',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 154983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-18',
 'seller_name': None,
 'title': 'Ford Mondeo 2.5 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2007}
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-28 11:11:55 [auto1.de] INFO: Saving data for LS92843: {'auction_closing_time': 1774713686.0, 'created_time': 1774292162.249993, 'last_price_update_time': 1774696315.566385}
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS92843') HTTP/1.1" 204 0
2026-03-28 11:11:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473
2026-03-28 11:11:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473
2026-03-28 11:11:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 429368c5-16de-5572-8779-c6f458c850bd with identifier: ZL89473 to the API
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:03:25Z',
 'fuel_type': 'petrol',
 'id': '429368c5-16de-5572-8779-c6f458c850bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL89473',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 130768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-28 11:11:55 [auto1.de] INFO: Saving data for ZL89473: {'auction_closing_time': 1774713805.0, 'created_time': 1773861339.839585, 'last_price_update_time': 1774696315.859565}
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL89473') HTTP/1.1" 204 0
2026-03-28 11:11:55 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-28 11:11:55 [auto1.de] INFO: Scrape type for HC91159: 2
2026-03-28 11:11:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159
2026-03-28 11:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f0cc5f-b557-5022-af94-650154451bd6 with scrape type 2
2026-03-28 11:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f0cc5f-b557-5022-af94-650154451bd6 with scrape type 2
2026-03-28 11:11:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f0cc5f-b557-5022-af94-650154451bd6, identifier: HC91159
2026-03-28 11:11:55 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-28 11:11:55 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-28 11:11:55 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-28 11:11:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-28 11:11:56 [auto1.de] INFO: Scrape type for MK08111: 2
2026-03-28 11:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111
2026-03-28 11:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with scrape type 2
2026-03-28 11:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with scrape type 2
2026-03-28 11:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1, identifier: MK08111
2026-03-28 11:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159
2026-03-28 11:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159
2026-03-28 11:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f0cc5f-b557-5022-af94-650154451bd6 with identifier: HC91159 to the API
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:44:12Z',
 'fuel_type': 'diesel',
 'id': '81f0cc5f-b557-5022-af94-650154451bd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC91159',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 136248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.6 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-28 11:11:56 [auto1.de] INFO: Saving data for HC91159: {'auction_closing_time': 1774716252.0, 'created_time': 1774294632.616438, 'last_price_update_time': 1774696316.381097}
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC91159') HTTP/1.1" 204 0
2026-03-28 11:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111
2026-03-28 11:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111
2026-03-28 11:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca2f32e2-e041-5ec7-970a-8bacd89d8bd1 with identifier: MK08111 to the API
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:24:49Z',
 'fuel_type': 'petrol',
 'id': 'ca2f32e2-e041-5ec7-970a-8bacd89d8bd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK08111',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 108171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-22',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-28 11:11:56 [auto1.de] INFO: Saving data for MK08111: {'auction_closing_time': 1774715089.0, 'created_time': 1773831554.586064, 'last_price_update_time': 1774696316.699824}
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK08111') HTTP/1.1" 204 0
2026-03-28 11:11:56 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-28 11:11:56 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-28 11:11:56 [auto1.de] INFO: Scrape type for YZ54178: 2
2026-03-28 11:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178
2026-03-28 11:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d904c0d-27fa-5839-a373-84088e8e493a with scrape type 2
2026-03-28 11:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d904c0d-27fa-5839-a373-84088e8e493a with scrape type 2
2026-03-28 11:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d904c0d-27fa-5839-a373-84088e8e493a, identifier: YZ54178
2026-03-28 11:11:56 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-28 11:11:56 [auto1.de] INFO: Scrape type for CT18435: 2
2026-03-28 11:11:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435
2026-03-28 11:11:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e23ef057-5cd6-5e2b-a70d-a3542464994f with scrape type 2
2026-03-28 11:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e23ef057-5cd6-5e2b-a70d-a3542464994f with scrape type 2
2026-03-28 11:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e23ef057-5cd6-5e2b-a70d-a3542464994f, identifier: CT18435
2026-03-28 11:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178
2026-03-28 11:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178
2026-03-28 11:11:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d904c0d-27fa-5839-a373-84088e8e493a with identifier: YZ54178 to the API
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:32:37Z',
 'fuel_type': 'petrol',
 'id': '4d904c0d-27fa-5839-a373-84088e8e493a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ54178',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 179068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-25',
 'seller_name': None,
 'title': 'Audi S3 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2007}
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [auto1.de] INFO: Saving data for YZ54178: {'auction_closing_time': 1774715557.0, 'created_time': 1774291073.364745, 'last_price_update_time': 1774696317.337039}
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ54178') HTTP/1.1" 204 0
2026-03-28 11:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435
2026-03-28 11:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435
2026-03-28 11:11:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e23ef057-5cd6-5e2b-a70d-a3542464994f with identifier: CT18435 to the API
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:47Z',
 'fuel_type': 'diesel',
 'id': 'e23ef057-5cd6-5e2b-a70d-a3542464994f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT18435',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 200838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Ford Focus 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [auto1.de] INFO: Saving data for CT18435: {'auction_closing_time': 1774713767.0, 'created_time': 1773387332.721525, 'last_price_update_time': 1774696317.743575}
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT18435') HTTP/1.1" 204 0
2026-03-28 11:11:57 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-28 11:11:57 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-28 11:11:57 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [auto1.de] INFO: Scrape type for NZ01572: 2
2026-03-28 11:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572
2026-03-28 11:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc7173c4-6055-5527-abce-5252f34ae246 with scrape type 2
2026-03-28 11:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc7173c4-6055-5527-abce-5252f34ae246 with scrape type 2
2026-03-28 11:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc7173c4-6055-5527-abce-5252f34ae246, identifier: NZ01572
2026-03-28 11:11:57 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-28 11:11:57 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-28 11:11:57 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [auto1.de] INFO: Scrape type for RR13548: 2
2026-03-28 11:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548
2026-03-28 11:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with scrape type 2
2026-03-28 11:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with scrape type 2
2026-03-28 11:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e, identifier: RR13548
2026-03-28 11:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572
2026-03-28 11:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572
2026-03-28 11:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc7173c4-6055-5527-abce-5252f34ae246 with identifier: NZ01572 to the API
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:09:11Z',
 'fuel_type': 'petrol',
 'id': 'cc7173c4-6055-5527-abce-5252f34ae246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ01572',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 57689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [auto1.de] INFO: Saving data for NZ01572: {'auction_closing_time': 1774714151.0, 'created_time': 1773775084.116803, 'last_price_update_time': 1774696318.377978}
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ01572') HTTP/1.1" 204 0
2026-03-28 11:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548
2026-03-28 11:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548
2026-03-28 11:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07ac2543-6e87-54bf-9948-4bc2c2a5d49e with identifier: RR13548 to the API
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:31:11Z',
 'fuel_type': 'diesel',
 'id': '07ac2543-6e87-54bf-9948-4bc2c2a5d49e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR13548',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 159552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [auto1.de] INFO: Saving data for RR13548: {'auction_closing_time': 1774715471.0, 'created_time': 1773302871.025354, 'last_price_update_time': 1774696318.670736}
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR13548') HTTP/1.1" 204 0
2026-03-28 11:11:58 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-28 11:11:58 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-28 11:11:58 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-28 11:11:58 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-28 11:11:58 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-28 11:11:58 [auto1.de] INFO: Found listing with ID: LZ15789
2026-03-28 11:11:58 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [auto1.de] INFO: Scrape type for BP97465: 2
2026-03-28 11:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465
2026-03-28 11:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ba11a15-316d-56a8-a54d-51082370b945 with scrape type 2
2026-03-28 11:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ba11a15-316d-56a8-a54d-51082370b945 with scrape type 2
2026-03-28 11:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ba11a15-316d-56a8-a54d-51082370b945, identifier: BP97465
2026-03-28 11:11:58 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-28 11:11:58 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [auto1.de] INFO: Scrape type for GK55952: 2
2026-03-28 11:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952
2026-03-28 11:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 084bb1bc-1db1-5c53-913d-6300f03782cd with scrape type 2
2026-03-28 11:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 084bb1bc-1db1-5c53-913d-6300f03782cd with scrape type 2
2026-03-28 11:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 084bb1bc-1db1-5c53-913d-6300f03782cd, identifier: GK55952
2026-03-28 11:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465
2026-03-28 11:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465
2026-03-28 11:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ba11a15-316d-56a8-a54d-51082370b945 with identifier: BP97465 to the API
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:55:34Z',
 'fuel_type': 'petrol',
 'id': '0ba11a15-316d-56a8-a54d-51082370b945',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP97465',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 194329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [auto1.de] INFO: Saving data for BP97465: {'auction_closing_time': 1774716934.0, 'created_time': 1773303861.074413, 'last_price_update_time': 1774696319.195784}
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP97465') HTTP/1.1" 204 0
2026-03-28 11:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952
2026-03-28 11:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952
2026-03-28 11:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 084bb1bc-1db1-5c53-913d-6300f03782cd with identifier: GK55952 to the API
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:34:13Z',
 'fuel_type': 'petrol',
 'id': '084bb1bc-1db1-5c53-913d-6300f03782cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK55952',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 142994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-26',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Turbo BRABUS BRABUS Xclusive',
 'transmission': 'automatic',
 'trim': 'BRABUS BRABUS Xclusive',
 'year': 2014}
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [auto1.de] INFO: Saving data for GK55952: {'auction_closing_time': 1774715653.0, 'created_time': 1773859000.563124, 'last_price_update_time': 1774696319.629093}
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK55952') HTTP/1.1" 204 0
2026-03-28 11:11:59 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-28 11:11:59 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-28 11:11:59 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-28 11:11:59 [auto1.de] INFO: Found listing with ID: ZG62657
2026-03-28 11:11:59 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [auto1.de] INFO: Scrape type for HB27474: 2
2026-03-28 11:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474
2026-03-28 11:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0ee91dc-75c7-5a56-b5df-750e5fd39584 with scrape type 2
2026-03-28 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0ee91dc-75c7-5a56-b5df-750e5fd39584 with scrape type 2
2026-03-28 11:11:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0ee91dc-75c7-5a56-b5df-750e5fd39584, identifier: HB27474
2026-03-28 11:11:59 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-28 11:11:59 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-28 11:11:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474
2026-03-28 11:11:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474
2026-03-28 11:11:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0ee91dc-75c7-5a56-b5df-750e5fd39584 with identifier: HB27474 to the API
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:57:52Z',
 'fuel_type': 'petrol',
 'id': 'c0ee91dc-75c7-5a56-b5df-750e5fd39584',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB27474',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 95609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Edition-S',
 'transmission': 'manual',
 'trim': 'Edition-S',
 'year': 2016}
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [auto1.de] INFO: Saving data for HB27474: {'auction_closing_time': 1774717072.0, 'created_time': 1774263226.954427, 'last_price_update_time': 1774696320.05107}
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB27474') HTTP/1.1" 204 0
2026-03-28 11:12:00 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-28 11:12:00 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [auto1.de] INFO: Scrape type for DZ26190: 2
2026-03-28 11:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190
2026-03-28 11:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83321f98-14a4-5c31-b76f-553e6c401692 with scrape type 2
2026-03-28 11:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83321f98-14a4-5c31-b76f-553e6c401692 with scrape type 2
2026-03-28 11:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83321f98-14a4-5c31-b76f-553e6c401692, identifier: DZ26190
2026-03-28 11:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190
2026-03-28 11:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190
2026-03-28 11:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83321f98-14a4-5c31-b76f-553e6c401692 with identifier: DZ26190 to the API
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:44:09Z',
 'fuel_type': 'petrol',
 'id': '83321f98-14a4-5c31-b76f-553e6c401692',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ26190',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 191765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-12',
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [auto1.de] INFO: Saving data for DZ26190: {'auction_closing_time': 1774716249.0, 'created_time': 1773859002.527609, 'last_price_update_time': 1774696320.478224}
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ26190') HTTP/1.1" 204 0
2026-03-28 11:12:00 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-28 11:12:00 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-28 11:12:00 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [auto1.de] INFO: Scrape type for ZV61779: 2
2026-03-28 11:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779
2026-03-28 11:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c1a7600-ef21-5d70-8567-de4d1cedd691 with scrape type 2
2026-03-28 11:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c1a7600-ef21-5d70-8567-de4d1cedd691 with scrape type 2
2026-03-28 11:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c1a7600-ef21-5d70-8567-de4d1cedd691, identifier: ZV61779
2026-03-28 11:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779
2026-03-28 11:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779
2026-03-28 11:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c1a7600-ef21-5d70-8567-de4d1cedd691 with identifier: ZV61779 to the API
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:53:56Z',
 'fuel_type': 'petrol',
 'id': '4c1a7600-ef21-5d70-8567-de4d1cedd691',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV61779',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 133452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-11',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 400 CGI Shooting Brake 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2017}
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [auto1.de] INFO: Saving data for ZV61779: {'auction_closing_time': 1774716836.0, 'created_time': 1774291071.471659, 'last_price_update_time': 1774696320.901986}
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV61779') HTTP/1.1" 204 0
2026-03-28 11:12:01 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-28 11:12:01 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-28 11:12:01 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-28 11:12:01 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [auto1.de] INFO: Scrape type for FY57679: 2
2026-03-28 11:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679
2026-03-28 11:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with scrape type 2
2026-03-28 11:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with scrape type 2
2026-03-28 11:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6ca2c54-5030-5f3a-8640-b78c7fd2f325, identifier: FY57679
2026-03-28 11:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679
2026-03-28 11:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679
2026-03-28 11:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6ca2c54-5030-5f3a-8640-b78c7fd2f325 with identifier: FY57679 to the API
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:16:04Z',
 'fuel_type': 'hybrid',
 'id': 'e6ca2c54-5030-5f3a-8640-b78c7fd2f325',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY57679',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 68902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-17',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [auto1.de] INFO: Saving data for FY57679: {'auction_closing_time': 1774714564.0, 'created_time': 1773775424.423979, 'last_price_update_time': 1774696321.41918}
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY57679') HTTP/1.1" 204 0
2026-03-28 11:12:01 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-28 11:12:01 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-28 11:12:01 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [auto1.de] INFO: Scrape type for JY20975: 2
2026-03-28 11:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975
2026-03-28 11:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with scrape type 2
2026-03-28 11:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with scrape type 2
2026-03-28 11:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b99ce715-5408-51fb-a5dc-b1e12bba4dd9, identifier: JY20975
2026-03-28 11:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975
2026-03-28 11:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975
2026-03-28 11:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b99ce715-5408-51fb-a5dc-b1e12bba4dd9 with identifier: JY20975 to the API
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:46Z',
 'fuel_type': 'petrol',
 'id': 'b99ce715-5408-51fb-a5dc-b1e12bba4dd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY20975',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 31538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-21',
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2023}
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [auto1.de] INFO: Saving data for JY20975: {'auction_closing_time': 1774714306.0, 'created_time': 1774264193.656289, 'last_price_update_time': 1774696321.823669}
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY20975') HTTP/1.1" 204 0
2026-03-28 11:12:01 [auto1.de] INFO: Found listing with ID: YD14218
2026-03-28 11:12:01 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [auto1.de] INFO: Scrape type for JK09354: 2
2026-03-28 11:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354
2026-03-28 11:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c2a8801-2849-5b91-9ca2-812afe0accf1 with scrape type 2
2026-03-28 11:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c2a8801-2849-5b91-9ca2-812afe0accf1 with scrape type 2
2026-03-28 11:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c2a8801-2849-5b91-9ca2-812afe0accf1, identifier: JK09354
2026-03-28 11:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354
2026-03-28 11:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354
2026-03-28 11:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c2a8801-2849-5b91-9ca2-812afe0accf1 with identifier: JK09354 to the API
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:57Z',
 'fuel_type': 'diesel',
 'id': '5c2a8801-2849-5b91-9ca2-812afe0accf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK09354',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 119096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-14',
 'seller_name': None,
 'title': 'Audi A4 35 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-28 11:12:02 [auto1.de] INFO: Saving data for JK09354: {'auction_closing_time': 1774714317.0, 'created_time': 1773308000.018424, 'last_price_update_time': 1774696322.252419}
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK09354') HTTP/1.1" 204 0
2026-03-28 11:12:02 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-28 11:12:02 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-28 11:12:02 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL77379%27 HTTP/1.1" 200 None
2026-03-28 11:12:02 [auto1.de] INFO: Scrape type for SL77379: 0
2026-03-28 11:12:02 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-28 11:12:02 [auto1.de] INFO: Scrape type for AZ42176: 2
2026-03-28 11:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176
2026-03-28 11:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with scrape type 2
2026-03-28 11:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with scrape type 2
2026-03-28 11:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c, identifier: AZ42176
2026-03-28 11:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176
2026-03-28 11:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176
2026-03-28 11:12:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79eedd0f-420d-5877-a1ac-1dec1bd32d4c with identifier: AZ42176 to the API
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:51:22Z',
 'fuel_type': 'petrol',
 'id': '79eedd0f-420d-5877-a1ac-1dec1bd32d4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ42176',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 210584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-27',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-28 11:12:02 [auto1.de] INFO: Saving data for AZ42176: {'auction_closing_time': 1774716682.0, 'created_time': 1773135092.266863, 'last_price_update_time': 1774696322.682482}
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ42176') HTTP/1.1" 204 0
2026-03-28 11:12:02 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-28 11:12:02 [auto1.de] INFO: Channel: 24h | Page: 224 | totalHits: 9709 | hits on page: 40
2026-03-28 11:12:02 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-28 11:12:02 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-28 11:12:02 [auto1.de] INFO: Scrape type for XJ52823: 2
2026-03-28 11:12:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823
2026-03-28 11:12:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6bddd6e-1259-5bc5-ae10-973b2dccc634 with scrape type 2
2026-03-28 11:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6bddd6e-1259-5bc5-ae10-973b2dccc634 with scrape type 2
2026-03-28 11:12:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6bddd6e-1259-5bc5-ae10-973b2dccc634, identifier: XJ52823
2026-03-28 11:12:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823
2026-03-28 11:12:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823
2026-03-28 11:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6bddd6e-1259-5bc5-ae10-973b2dccc634 with identifier: XJ52823 to the API
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:49:51Z',
 'fuel_type': 'gas',
 'id': 'f6bddd6e-1259-5bc5-ae10-973b2dccc634',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ52823',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 128182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-14',
 'seller_name': None,
 'title': 'Opel Combo 1.6 Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2007}
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-28 11:12:03 [auto1.de] INFO: Saving data for XJ52823: {'auction_closing_time': 1774716591.0, 'created_time': 1773134420.851467, 'last_price_update_time': 1774696323.209975}
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ52823') HTTP/1.1" 204 0
2026-03-28 11:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:03 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-28 11:12:03 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-28 11:12:03 [auto1.de] INFO: Scrape type for UH96912: 2
2026-03-28 11:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912
2026-03-28 11:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58218d58-2d0b-52a0-a29d-2a6dffef178a with scrape type 2
2026-03-28 11:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58218d58-2d0b-52a0-a29d-2a6dffef178a with scrape type 2
2026-03-28 11:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58218d58-2d0b-52a0-a29d-2a6dffef178a, identifier: UH96912
2026-03-28 11:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912
2026-03-28 11:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912
2026-03-28 11:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58218d58-2d0b-52a0-a29d-2a6dffef178a with identifier: UH96912 to the API
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 387,
 'expiration_date': '2026-03-28T16:54:33Z',
 'fuel_type': 'petrol',
 'id': '58218d58-2d0b-52a0-a29d-2a6dffef178a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH96912',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 164074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 500 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2009}
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-28 11:12:03 [auto1.de] INFO: Saving data for UH96912: {'auction_closing_time': 1774716873.0, 'created_time': 1773134152.576679, 'last_price_update_time': 1774696323.70361}
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH96912') HTTP/1.1" 204 0
2026-03-28 11:12:03 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-28 11:12:03 [auto1.de] INFO: Scrape type for LN23623: 2
2026-03-28 11:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623
2026-03-28 11:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with scrape type 2
2026-03-28 11:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with scrape type 2
2026-03-28 11:12:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7, identifier: LN23623
2026-03-28 11:12:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623
2026-03-28 11:12:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623
2026-03-28 11:12:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d4ae872-bb7e-5fde-9e5f-a8712e029fb7 with identifier: LN23623 to the API
2026-03-28 11:12:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:06:04Z',
 'fuel_type': 'hybrid',
 'id': '2d4ae872-bb7e-5fde-9e5f-a8712e029fb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN23623',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 76884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-03',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2022}
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-28 11:12:04 [auto1.de] INFO: Saving data for LN23623: {'auction_closing_time': 1774713964.0, 'created_time': 1773830406.814358, 'last_price_update_time': 1774696324.125846}
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN23623') HTTP/1.1" 204 0
2026-03-28 11:12:04 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-28 11:12:04 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-28 11:12:04 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-28 11:12:04 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-28 11:12:04 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-28 11:12:04 [auto1.de] INFO: Scrape type for TY20606: 2
2026-03-28 11:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606
2026-03-28 11:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c063c708-91ba-5810-9f8f-8005f1f4822d with scrape type 2
2026-03-28 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c063c708-91ba-5810-9f8f-8005f1f4822d with scrape type 2
2026-03-28 11:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c063c708-91ba-5810-9f8f-8005f1f4822d, identifier: TY20606
2026-03-28 11:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606
2026-03-28 11:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606
2026-03-28 11:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c063c708-91ba-5810-9f8f-8005f1f4822d with identifier: TY20606 to the API
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:14Z',
 'fuel_type': 'petrol',
 'id': 'c063c708-91ba-5810-9f8f-8005f1f4822d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY20606',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 64971,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-14',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Journey',
 'transmission': 'automatic',
 'trim': 'Journey',
 'year': 2023}
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-28 11:12:04 [auto1.de] INFO: Saving data for TY20606: {'auction_closing_time': 1774714154.0, 'created_time': 1773383238.051134, 'last_price_update_time': 1774696324.544401}
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY20606') HTTP/1.1" 204 0
2026-03-28 11:12:04 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-28 11:12:04 [auto1.de] INFO: Scrape type for GD49252: 2
2026-03-28 11:12:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252
2026-03-28 11:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02bd64a-f1be-5e24-b147-9347c9d11809 with scrape type 2
2026-03-28 11:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02bd64a-f1be-5e24-b147-9347c9d11809 with scrape type 2
2026-03-28 11:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f02bd64a-f1be-5e24-b147-9347c9d11809, identifier: GD49252
2026-03-28 11:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252
2026-03-28 11:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252
2026-03-28 11:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f02bd64a-f1be-5e24-b147-9347c9d11809 with identifier: GD49252 to the API
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:25:23Z',
 'fuel_type': 'petrol',
 'id': 'f02bd64a-f1be-5e24-b147-9347c9d11809',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD49252',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 48483,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2020}
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-28 11:12:05 [auto1.de] INFO: Saving data for GD49252: {'auction_closing_time': 1774715123.0, 'created_time': 1773861488.63502, 'last_price_update_time': 1774696325.042713}
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD49252') HTTP/1.1" 204 0
2026-03-28 11:12:05 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-28 11:12:05 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-28 11:12:05 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-28 11:12:05 [auto1.de] INFO: Scrape type for BT34315: 2
2026-03-28 11:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315
2026-03-28 11:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with scrape type 2
2026-03-28 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with scrape type 2
2026-03-28 11:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 462fad6c-41c2-5a87-85d1-9ed0f67efd97, identifier: BT34315
2026-03-28 11:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315
2026-03-28 11:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315
2026-03-28 11:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 462fad6c-41c2-5a87-85d1-9ed0f67efd97 with identifier: BT34315 to the API
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:52:46Z',
 'fuel_type': 'petrol',
 'id': '462fad6c-41c2-5a87-85d1-9ed0f67efd97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT34315',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 108042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-19',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-28 11:12:05 [auto1.de] INFO: Saving data for BT34315: {'auction_closing_time': 1774716766.0, 'created_time': 1773381990.593559, 'last_price_update_time': 1774696325.480983}
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT34315') HTTP/1.1" 204 0
2026-03-28 11:12:05 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-28 11:12:05 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-28 11:12:05 [auto1.de] INFO: Scrape type for NE16717: 2
2026-03-28 11:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717
2026-03-28 11:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41d975f-1838-590a-814e-db4f5df86271 with scrape type 2
2026-03-28 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41d975f-1838-590a-814e-db4f5df86271 with scrape type 2
2026-03-28 11:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d41d975f-1838-590a-814e-db4f5df86271, identifier: NE16717
2026-03-28 11:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717
2026-03-28 11:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717
2026-03-28 11:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d41d975f-1838-590a-814e-db4f5df86271 with identifier: NE16717 to the API
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:38:40Z',
 'fuel_type': 'petrol',
 'id': 'd41d975f-1838-590a-814e-db4f5df86271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE16717',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 149299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350 CGI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-28 11:12:05 [auto1.de] INFO: Saving data for NE16717: {'auction_closing_time': 1774715920.0, 'created_time': 1773383449.392621, 'last_price_update_time': 1774696325.915051}
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE16717') HTTP/1.1" 204 0
2026-03-28 11:12:05 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-28 11:12:05 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [auto1.de] INFO: Scrape type for XP82440: 2
2026-03-28 11:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440
2026-03-28 11:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e7b782c-915a-5365-a586-e64e133b1eac with scrape type 2
2026-03-28 11:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e7b782c-915a-5365-a586-e64e133b1eac with scrape type 2
2026-03-28 11:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e7b782c-915a-5365-a586-e64e133b1eac, identifier: XP82440
2026-03-28 11:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440
2026-03-28 11:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440
2026-03-28 11:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e7b782c-915a-5365-a586-e64e133b1eac with identifier: XP82440 to the API
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:55:13Z',
 'fuel_type': 'petrol',
 'id': '4e7b782c-915a-5365-a586-e64e133b1eac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP82440',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 73340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-19',
 'seller_name': None,
 'title': 'Cupra Formentor 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [auto1.de] INFO: Saving data for XP82440: {'auction_closing_time': 1774716913.0, 'created_time': 1773138533.799474, 'last_price_update_time': 1774696326.473738}
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP82440') HTTP/1.1" 204 0
2026-03-28 11:12:06 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [auto1.de] INFO: Scrape type for JE71066: 2
2026-03-28 11:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066
2026-03-28 11:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94e624af-c21c-53bb-9b98-00e2082c8152 with scrape type 2
2026-03-28 11:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94e624af-c21c-53bb-9b98-00e2082c8152 with scrape type 2
2026-03-28 11:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94e624af-c21c-53bb-9b98-00e2082c8152, identifier: JE71066
2026-03-28 11:12:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:06 [scrapy.extensions.logstats] INFO: Crawled 441 pages (at 5 pages/min), scraped 757 items (at 71 items/min)
2026-03-28 11:12:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066
2026-03-28 11:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066
2026-03-28 11:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94e624af-c21c-53bb-9b98-00e2082c8152 with identifier: JE71066 to the API
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-28T16:13:04Z',
 'fuel_type': 'diesel',
 'id': '94e624af-c21c-53bb-9b98-00e2082c8152',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE71066',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 199158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-17',
 'seller_name': None,
 'title': 'Volvo S60 2.4 D5 AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2011}
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [auto1.de] INFO: Saving data for JE71066: {'auction_closing_time': 1774714384.0, 'created_time': 1774330542.272959, 'last_price_update_time': 1774696326.878308}
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE71066') HTTP/1.1" 204 0
2026-03-28 11:12:06 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-28 11:12:06 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-28 11:12:06 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [auto1.de] INFO: Scrape type for UV35373: 2
2026-03-28 11:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373
2026-03-28 11:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with scrape type 2
2026-03-28 11:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with scrape type 2
2026-03-28 11:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f, identifier: UV35373
2026-03-28 11:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373
2026-03-28 11:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373
2026-03-28 11:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9333e0f4-d27c-508e-a85f-d3fab7aadb9f with identifier: UV35373 to the API
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:01:07Z',
 'fuel_type': 'diesel',
 'id': '9333e0f4-d27c-508e-a85f-d3fab7aadb9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV35373',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 291851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-12',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [auto1.de] INFO: Saving data for UV35373: {'auction_closing_time': 1774713667.0, 'created_time': 1773689112.967782, 'last_price_update_time': 1774696327.291774}
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV35373') HTTP/1.1" 204 0
2026-03-28 11:12:07 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-28 11:12:07 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [auto1.de] INFO: Scrape type for LN88860: 2
2026-03-28 11:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860
2026-03-28 11:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with scrape type 2
2026-03-28 11:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with scrape type 2
2026-03-28 11:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9, identifier: LN88860
2026-03-28 11:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860
2026-03-28 11:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860
2026-03-28 11:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e0969dd-d8b2-56e7-ac64-2adf09551dd9 with identifier: LN88860 to the API
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 354,
 'expiration_date': '2026-03-28T16:54:07Z',
 'fuel_type': 'petrol',
 'id': '9e0969dd-d8b2-56e7-ac64-2adf09551dd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN88860',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 129255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-15',
 'seller_name': None,
 'title': 'BMW X3 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [auto1.de] INFO: Saving data for LN88860: {'auction_closing_time': 1774716847.0, 'created_time': 1773303519.535343, 'last_price_update_time': 1774696327.819789}
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN88860') HTTP/1.1" 204 0
2026-03-28 11:12:07 [auto1.de] INFO: Channel: 24h | Page: 225 | totalHits: 9709 | hits on page: 40
2026-03-28 11:12:07 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [auto1.de] INFO: Scrape type for RC50586: 2
2026-03-28 11:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586
2026-03-28 11:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 685be0a8-2cb0-510c-8e02-d2a2d364834b with scrape type 2
2026-03-28 11:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 685be0a8-2cb0-510c-8e02-d2a2d364834b with scrape type 2
2026-03-28 11:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 685be0a8-2cb0-510c-8e02-d2a2d364834b, identifier: RC50586
2026-03-28 11:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586
2026-03-28 11:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586
2026-03-28 11:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 685be0a8-2cb0-510c-8e02-d2a2d364834b with identifier: RC50586 to the API
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:56:45Z',
 'fuel_type': 'petrol',
 'id': '685be0a8-2cb0-510c-8e02-d2a2d364834b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC50586',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 182998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-29',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [auto1.de] INFO: Saving data for RC50586: {'auction_closing_time': 1774717005.0, 'created_time': 1773772767.037647, 'last_price_update_time': 1774696328.269035}
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC50586') HTTP/1.1" 204 0
2026-03-28 11:12:08 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [auto1.de] INFO: Scrape type for BL07705: 2
2026-03-28 11:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705
2026-03-28 11:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with scrape type 2
2026-03-28 11:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with scrape type 2
2026-03-28 11:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9, identifier: BL07705
2026-03-28 11:12:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:08 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [auto1.de] INFO: Scrape type for SG66874: 2
2026-03-28 11:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874
2026-03-28 11:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1de4729-38d0-5f1e-a0ac-82437315f359 with scrape type 2
2026-03-28 11:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1de4729-38d0-5f1e-a0ac-82437315f359 with scrape type 2
2026-03-28 11:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1de4729-38d0-5f1e-a0ac-82437315f359, identifier: SG66874
2026-03-28 11:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705
2026-03-28 11:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705
2026-03-28 11:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b8bc14-64fc-5809-ba5d-b99f1c3124b9 with identifier: BL07705 to the API
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:41:08Z',
 'fuel_type': 'petrol',
 'id': '65b8bc14-64fc-5809-ba5d-b99f1c3124b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL07705',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 211141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-22',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [auto1.de] INFO: Saving data for BL07705: {'auction_closing_time': 1774716068.0, 'created_time': 1773383434.873398, 'last_price_update_time': 1774696328.832652}
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL07705') HTTP/1.1" 204 0
2026-03-28 11:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874
2026-03-28 11:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874
2026-03-28 11:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1de4729-38d0-5f1e-a0ac-82437315f359 with identifier: SG66874 to the API
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:52:55Z',
 'fuel_type': 'petrol',
 'id': 'd1de4729-38d0-5f1e-a0ac-82437315f359',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG66874',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 109019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-09',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [auto1.de] INFO: Saving data for SG66874: {'auction_closing_time': 1774716775.0, 'created_time': 1773305322.502021, 'last_price_update_time': 1774696329.14924}
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG66874') HTTP/1.1" 204 0
2026-03-28 11:12:09 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-28 11:12:09 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-28 11:12:09 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-28 11:12:09 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [auto1.de] INFO: Scrape type for RZ99970: 2
2026-03-28 11:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970
2026-03-28 11:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with scrape type 2
2026-03-28 11:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with scrape type 2
2026-03-28 11:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111, identifier: RZ99970
2026-03-28 11:12:09 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [auto1.de] INFO: Scrape type for SG62181: 2
2026-03-28 11:12:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181
2026-03-28 11:12:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef1db094-54cf-55ed-8018-cdbe6b68dc7f with scrape type 2
2026-03-28 11:12:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef1db094-54cf-55ed-8018-cdbe6b68dc7f with scrape type 2
2026-03-28 11:12:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef1db094-54cf-55ed-8018-cdbe6b68dc7f, identifier: SG62181
2026-03-28 11:12:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970
2026-03-28 11:12:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970
2026-03-28 11:12:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f3d696f-5c7b-50cb-bc2b-0f66a171c111 with identifier: RZ99970 to the API
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:50:30Z',
 'fuel_type': 'petrol',
 'id': '9f3d696f-5c7b-50cb-bc2b-0f66a171c111',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ99970',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 124070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-09',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2009}
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [auto1.de] INFO: Saving data for RZ99970: {'auction_closing_time': 1774716630.0, 'created_time': 1774608365.526383, 'last_price_update_time': 1774696329.705882}
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ99970') HTTP/1.1" 204 0
2026-03-28 11:12:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181
2026-03-28 11:12:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181
2026-03-28 11:12:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef1db094-54cf-55ed-8018-cdbe6b68dc7f with identifier: SG62181 to the API
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:53:11Z',
 'fuel_type': 'petrol',
 'id': 'ef1db094-54cf-55ed-8018-cdbe6b68dc7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG62181',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 157725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Business Edition BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [auto1.de] INFO: Saving data for SG62181: {'auction_closing_time': 1774716791.0, 'created_time': 1774293913.418717, 'last_price_update_time': 1774696330.047518}
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG62181') HTTP/1.1" 204 0
2026-03-28 11:12:10 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-28 11:12:10 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-28 11:12:10 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-28 11:12:10 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-28 11:12:10 [auto1.de] INFO: Found listing with ID: WL25699
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL25699%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [auto1.de] INFO: Scrape type for WL25699: 2
2026-03-28 11:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with identifier: WL25699
2026-03-28 11:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with scrape type 2
2026-03-28 11:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with scrape type 2
2026-03-28 11:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a, identifier: WL25699
2026-03-28 11:12:10 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [auto1.de] INFO: Scrape type for RE51747: 2
2026-03-28 11:12:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747
2026-03-28 11:12:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with scrape type 2
2026-03-28 11:12:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with scrape type 2
2026-03-28 11:12:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353, identifier: RE51747
2026-03-28 11:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with identifier: WL25699
2026-03-28 11:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with identifier: WL25699
2026-03-28 11:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a with identifier: WL25699 to the API
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:08Z',
 'fuel_type': 'diesel',
 'id': '66bf0c68-3b5b-5c10-89e3-96b5d8a6ba6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL25699',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 225313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL25699%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [auto1.de] INFO: Saving data for WL25699: {'auction_closing_time': 1774716968.0, 'created_time': 1773382477.562391, 'last_price_update_time': 1774696330.606014}
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL25699') HTTP/1.1" 204 0
2026-03-28 11:12:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747
2026-03-28 11:12:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747
2026-03-28 11:12:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353 with identifier: RE51747 to the API
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:29:20Z',
 'fuel_type': 'petrol',
 'id': '81f1ff9e-f9bb-55b2-afcd-12e5ab2cc353',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE51747',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 183217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-28 11:12:11 [auto1.de] INFO: Saving data for RE51747: {'auction_closing_time': 1774715360.0, 'created_time': 1773812130.262438, 'last_price_update_time': 1774696331.030133}
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE51747') HTTP/1.1" 204 0
2026-03-28 11:12:11 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-28 11:12:11 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-28 11:12:11 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-28 11:12:11 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-28 11:12:11 [auto1.de] INFO: Scrape type for SY47772: 2
2026-03-28 11:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772
2026-03-28 11:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53242f5d-d059-53ce-9533-c8e9f9ba632c with scrape type 2
2026-03-28 11:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53242f5d-d059-53ce-9533-c8e9f9ba632c with scrape type 2
2026-03-28 11:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53242f5d-d059-53ce-9533-c8e9f9ba632c, identifier: SY47772
2026-03-28 11:12:11 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-28 11:12:11 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-28 11:12:11 [auto1.de] INFO: Scrape type for LV47567: 2
2026-03-28 11:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567
2026-03-28 11:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with scrape type 2
2026-03-28 11:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with scrape type 2
2026-03-28 11:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9, identifier: LV47567
2026-03-28 11:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772
2026-03-28 11:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772
2026-03-28 11:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53242f5d-d059-53ce-9533-c8e9f9ba632c with identifier: SY47772 to the API
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:08:34Z',
 'fuel_type': 'petrol',
 'id': '53242f5d-d059-53ce-9533-c8e9f9ba632c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY47772',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 88581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI Clubsport',
 'transmission': 'automatic',
 'trim': 'GTI Clubsport',
 'year': 2021}
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-28 11:12:11 [auto1.de] INFO: Saving data for SY47772: {'auction_closing_time': 1774714114.0, 'created_time': 1773861577.476407, 'last_price_update_time': 1774696331.589435}
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY47772') HTTP/1.1" 204 0
2026-03-28 11:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567
2026-03-28 11:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567
2026-03-28 11:12:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9 with identifier: LV47567 to the API
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:07:44Z',
 'fuel_type': 'petrol',
 'id': 'c7aa9422-6df9-5ac7-95cf-0beafd6f2eb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV47567',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SL-Klasse',
 'odometer': 111522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-03',
 'seller_name': None,
 'title': 'Mercedes-Benz SL-Klasse SL 350',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-28 11:12:11 [auto1.de] INFO: Saving data for LV47567: {'auction_closing_time': 1774714064.0, 'created_time': 1773136055.532977, 'last_price_update_time': 1774696331.888214}
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV47567') HTTP/1.1" 204 0
2026-03-28 11:12:11 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-28 11:12:11 [auto1.de] INFO: Scrape type for HY54532: 2
2026-03-28 11:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532
2026-03-28 11:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 174b828c-aa89-5c29-a97f-720383dbdb48 with scrape type 2
2026-03-28 11:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 174b828c-aa89-5c29-a97f-720383dbdb48 with scrape type 2
2026-03-28 11:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 174b828c-aa89-5c29-a97f-720383dbdb48, identifier: HY54532
2026-03-28 11:12:12 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-28 11:12:12 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-28 11:12:12 [auto1.de] INFO: Scrape type for ZV21910: 2
2026-03-28 11:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910
2026-03-28 11:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e2149d-fd64-58e9-9a74-281aee60537d with scrape type 2
2026-03-28 11:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e2149d-fd64-58e9-9a74-281aee60537d with scrape type 2
2026-03-28 11:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4e2149d-fd64-58e9-9a74-281aee60537d, identifier: ZV21910
2026-03-28 11:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532
2026-03-28 11:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532
2026-03-28 11:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 174b828c-aa89-5c29-a97f-720383dbdb48 with identifier: HY54532 to the API
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:15Z',
 'fuel_type': 'petrol',
 'id': '174b828c-aa89-5c29-a97f-720383dbdb48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY54532',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 56341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2020}
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-28 11:12:12 [auto1.de] INFO: Saving data for HY54532: {'auction_closing_time': 1774715835.0, 'created_time': 1773427044.165479, 'last_price_update_time': 1774696332.421662}
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY54532') HTTP/1.1" 204 0
2026-03-28 11:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910
2026-03-28 11:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910
2026-03-28 11:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4e2149d-fd64-58e9-9a74-281aee60537d with identifier: ZV21910 to the API
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-28T16:54:54Z',
 'fuel_type': 'diesel',
 'id': 'b4e2149d-fd64-58e9-9a74-281aee60537d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV21910',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 187457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2016}
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-28 11:12:12 [auto1.de] INFO: Saving data for ZV21910: {'auction_closing_time': 1774716894.0, 'created_time': 1773387352.387303, 'last_price_update_time': 1774696332.740547}
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV21910') HTTP/1.1" 204 0
2026-03-28 11:12:12 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-28 11:12:12 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-28 11:12:12 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-28 11:12:12 [auto1.de] INFO: Scrape type for YJ30839: 2
2026-03-28 11:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839
2026-03-28 11:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with scrape type 2
2026-03-28 11:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with scrape type 2
2026-03-28 11:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c, identifier: YJ30839
2026-03-28 11:12:12 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-28 11:12:12 [auto1.de] INFO: Scrape type for GG36618: 2
2026-03-28 11:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618
2026-03-28 11:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2096cefb-abf5-587f-992e-f93d41aa8e65 with scrape type 2
2026-03-28 11:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2096cefb-abf5-587f-992e-f93d41aa8e65 with scrape type 2
2026-03-28 11:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2096cefb-abf5-587f-992e-f93d41aa8e65, identifier: GG36618
2026-03-28 11:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839
2026-03-28 11:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839
2026-03-28 11:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61e3541e-02fa-5f2f-8b3a-019b4c59ff9c with identifier: YJ30839 to the API
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:58:54Z',
 'fuel_type': 'diesel',
 'id': '61e3541e-02fa-5f2f-8b3a-019b4c59ff9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ30839',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 115221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-01',
 'seller_name': None,
 'title': 'MINI Countryman Cooper SD ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2016}
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-28 11:12:13 [auto1.de] INFO: Saving data for YJ30839: {'auction_closing_time': 1774717134.0, 'created_time': 1773305735.047043, 'last_price_update_time': 1774696333.280418}
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ30839') HTTP/1.1" 204 0
2026-03-28 11:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618
2026-03-28 11:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618
2026-03-28 11:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2096cefb-abf5-587f-992e-f93d41aa8e65 with identifier: GG36618 to the API
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:56:22Z',
 'fuel_type': 'diesel',
 'id': '2096cefb-abf5-587f-992e-f93d41aa8e65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG36618',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 198518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-10',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 TDI Connect',
 'transmission': 'manual',
 'trim': 'Connect',
 'year': 2016}
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-28 11:12:13 [auto1.de] INFO: Saving data for GG36618: {'auction_closing_time': 1774716982.0, 'created_time': 1774262652.68583, 'last_price_update_time': 1774696333.709108}
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG36618') HTTP/1.1" 204 0
2026-03-28 11:12:13 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-28 11:12:13 [auto1.de] INFO: Scrape type for PS83332: 2
2026-03-28 11:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332
2026-03-28 11:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with scrape type 2
2026-03-28 11:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with scrape type 2
2026-03-28 11:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5, identifier: PS83332
2026-03-28 11:12:13 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-28 11:12:13 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-28 11:12:13 [auto1.de] INFO: Scrape type for EZ36931: 2
2026-03-28 11:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931
2026-03-28 11:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with scrape type 2
2026-03-28 11:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with scrape type 2
2026-03-28 11:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063, identifier: EZ36931
2026-03-28 11:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332
2026-03-28 11:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332
2026-03-28 11:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ff99d9d-1f8c-5726-90c5-92466b5dfef5 with identifier: PS83332 to the API
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:53:38Z',
 'fuel_type': 'diesel',
 'id': '2ff99d9d-1f8c-5726-90c5-92466b5dfef5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS83332',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery 4',
 'odometer': 173269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-22',
 'seller_name': None,
 'title': 'Land Rover Discovery 4 3.0 TD V6 TDV6 S',
 'transmission': 'automatic',
 'trim': 'TDV6 S',
 'year': 2015}
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-28 11:12:14 [auto1.de] INFO: Saving data for PS83332: {'auction_closing_time': 1774716818.0, 'created_time': 1773134716.789018, 'last_price_update_time': 1774696334.289499}
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS83332') HTTP/1.1" 204 0
2026-03-28 11:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931
2026-03-28 11:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931
2026-03-28 11:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4c87d2b-ec2b-582f-8d87-0ed90b4e0063 with identifier: EZ36931 to the API
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:23:44Z',
 'fuel_type': 'petrol',
 'id': 'b4c87d2b-ec2b-582f-8d87-0ed90b4e0063',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ36931',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 97885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-28 11:12:14 [auto1.de] INFO: Saving data for EZ36931: {'auction_closing_time': 1774715024.0, 'created_time': 1772728533.609466, 'last_price_update_time': 1774696334.621578}
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ36931') HTTP/1.1" 204 0
2026-03-28 11:12:14 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-28 11:12:14 [auto1.de] INFO: Scrape type for JZ53783: 2
2026-03-28 11:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783
2026-03-28 11:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d253bb53-62aa-5b91-bb8e-b588abe03ee6 with scrape type 2
2026-03-28 11:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d253bb53-62aa-5b91-bb8e-b588abe03ee6 with scrape type 2
2026-03-28 11:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d253bb53-62aa-5b91-bb8e-b588abe03ee6, identifier: JZ53783
2026-03-28 11:12:14 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-28 11:12:14 [auto1.de] INFO: Scrape type for JC98855: 2
2026-03-28 11:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855
2026-03-28 11:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with scrape type 2
2026-03-28 11:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with scrape type 2
2026-03-28 11:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a, identifier: JC98855
2026-03-28 11:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783
2026-03-28 11:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783
2026-03-28 11:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d253bb53-62aa-5b91-bb8e-b588abe03ee6 with identifier: JZ53783 to the API
2026-03-28 11:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:10:26Z',
 'fuel_type': 'diesel',
 'id': 'd253bb53-62aa-5b91-bb8e-b588abe03ee6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ53783',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 67594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seller_name': None,
 'title': 'Peugeot 2008 1.5 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2021}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Saving data for JZ53783: {'auction_closing_time': 1774714226.0, 'created_time': 1773304497.641106, 'last_price_update_time': 1774696335.164042}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ53783') HTTP/1.1" 204 0
2026-03-28 11:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855
2026-03-28 11:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855
2026-03-28 11:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a with identifier: JC98855 to the API
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:55:37Z',
 'fuel_type': 'petrol',
 'id': '5aaf99a7-0b9d-5b6a-8ef3-06ab6307301a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC98855',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 76280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-10',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Saving data for JC98855: {'auction_closing_time': 1774716937.0, 'created_time': 1773383239.787443, 'last_price_update_time': 1774696335.467626}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC98855') HTTP/1.1" 204 0
2026-03-28 11:12:15 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-28 11:12:15 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Scrape type for JH35819: 2
2026-03-28 11:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819
2026-03-28 11:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c0106e-330b-52a8-849a-e224554552db with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c0106e-330b-52a8-849a-e224554552db with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66c0106e-330b-52a8-849a-e224554552db, identifier: JH35819
2026-03-28 11:12:15 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-28 11:12:15 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-28 11:12:15 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-28 11:12:15 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-28 11:12:15 [auto1.de] INFO: Scrape type for NN41224: 2
2026-03-28 11:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224
2026-03-28 11:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24577de-6e34-5ea3-ace2-47233e613236 with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d24577de-6e34-5ea3-ace2-47233e613236 with scrape type 2
2026-03-28 11:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d24577de-6e34-5ea3-ace2-47233e613236, identifier: NN41224
2026-03-28 11:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819
2026-03-28 11:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819
2026-03-28 11:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66c0106e-330b-52a8-849a-e224554552db with identifier: JH35819 to the API
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:54:24Z',
 'fuel_type': 'petrol',
 'id': '66c0106e-330b-52a8-849a-e224554552db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH35819',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 115436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-27',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-28 11:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-28 11:12:16 [auto1.de] INFO: Saving data for JH35819: {'auction_closing_time': 1774716864.0, 'created_time': 1773773156.4411, 'last_price_update_time': 1774696336.002833}
2026-03-28 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH35819') HTTP/1.1" 204 0
2026-03-28 11:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224
2026-03-28 11:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224
2026-03-28 11:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d24577de-6e34-5ea3-ace2-47233e613236 with identifier: NN41224 to the API
2026-03-28 11:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:38:22Z',
 'fuel_type': 'diesel',
 'id': 'd24577de-6e34-5ea3-ace2-47233e613236',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN41224',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 204751,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-31',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2011}
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-28 11:12:17 [auto1.de] INFO: Saving data for NN41224: {'auction_closing_time': 1774715902.0, 'created_time': 1773305170.778331, 'last_price_update_time': 1774696337.216491}
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NN41224') HTTP/1.1" 204 0
2026-03-28 11:12:17 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-28 11:12:17 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-28 11:12:17 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-28 11:12:17 [auto1.de] INFO: Scrape type for WA46177: 2
2026-03-28 11:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177
2026-03-28 11:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89e3f994-8aea-5935-bc91-2b277b978b16 with scrape type 2
2026-03-28 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89e3f994-8aea-5935-bc91-2b277b978b16 with scrape type 2
2026-03-28 11:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89e3f994-8aea-5935-bc91-2b277b978b16, identifier: WA46177
2026-03-28 11:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177
2026-03-28 11:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177
2026-03-28 11:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89e3f994-8aea-5935-bc91-2b277b978b16 with identifier: WA46177 to the API
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:05:35Z',
 'fuel_type': 'diesel',
 'id': '89e3f994-8aea-5935-bc91-2b277b978b16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA46177',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 317737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-28 11:12:17 [auto1.de] INFO: Saving data for WA46177: {'auction_closing_time': 1774713935.0, 'created_time': 1774291010.261216, 'last_price_update_time': 1774696337.67778}
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA46177') HTTP/1.1" 204 0
2026-03-28 11:12:17 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-28 11:12:17 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-28 11:12:17 [auto1.de] INFO: Scrape type for BC03765: 2
2026-03-28 11:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765
2026-03-28 11:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96e779b-2971-5caf-bea1-537a3b19961b with scrape type 2
2026-03-28 11:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96e779b-2971-5caf-bea1-537a3b19961b with scrape type 2
2026-03-28 11:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96e779b-2971-5caf-bea1-537a3b19961b, identifier: BC03765
2026-03-28 11:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765
2026-03-28 11:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765
2026-03-28 11:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96e779b-2971-5caf-bea1-537a3b19961b with identifier: BC03765 to the API
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:53:09Z',
 'fuel_type': 'diesel',
 'id': 'c96e779b-2971-5caf-bea1-537a3b19961b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC03765',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 229716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-02',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [auto1.de] INFO: Saving data for BC03765: {'auction_closing_time': 1774716789.0, 'created_time': 1773426929.674773, 'last_price_update_time': 1774696338.100917}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC03765') HTTP/1.1" 204 0
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [auto1.de] INFO: Scrape type for HN35762: 2
2026-03-28 11:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762
2026-03-28 11:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb8930d2-a6d8-5270-81b2-7e99df3990b9 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb8930d2-a6d8-5270-81b2-7e99df3990b9 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb8930d2-a6d8-5270-81b2-7e99df3990b9, identifier: HN35762
2026-03-28 11:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762
2026-03-28 11:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762
2026-03-28 11:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb8930d2-a6d8-5270-81b2-7e99df3990b9 with identifier: HN35762 to the API
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:58:41Z',
 'fuel_type': 'diesel',
 'id': 'bb8930d2-a6d8-5270-81b2-7e99df3990b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN35762',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 287654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-04',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2017}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [auto1.de] INFO: Saving data for HN35762: {'auction_closing_time': 1774717121.0, 'created_time': 1774293896.249834, 'last_price_update_time': 1774696338.508693}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN35762') HTTP/1.1" 204 0
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: PU35807
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-28 11:12:18 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [auto1.de] INFO: Scrape type for HY74574: 2
2026-03-28 11:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574
2026-03-28 11:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85474071-9d19-5f7a-a02f-3cf7a61694a9 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85474071-9d19-5f7a-a02f-3cf7a61694a9 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85474071-9d19-5f7a-a02f-3cf7a61694a9, identifier: HY74574
2026-03-28 11:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574
2026-03-28 11:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574
2026-03-28 11:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85474071-9d19-5f7a-a02f-3cf7a61694a9 with identifier: HY74574 to the API
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:33:26Z',
 'fuel_type': 'petrol',
 'id': '85474071-9d19-5f7a-a02f-3cf7a61694a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY74574',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 47136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-12',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [auto1.de] INFO: Saving data for HY74574: {'auction_closing_time': 1774715606.0, 'created_time': 1773860952.842866, 'last_price_update_time': 1774696338.912163}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY74574') HTTP/1.1" 204 0
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [auto1.de] INFO: Scrape type for DJ60943: 2
2026-03-28 11:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943
2026-03-28 11:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1, identifier: DJ60943
2026-03-28 11:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943
2026-03-28 11:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943
2026-03-28 11:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 617e169a-c15a-5ed1-8130-d3cf2f5edaa1 with identifier: DJ60943 to the API
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:14:41Z',
 'fuel_type': 'petrol',
 'id': '617e169a-c15a-5ed1-8130-d3cf2f5edaa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ60943',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 23560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-26',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2021}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [auto1.de] INFO: Saving data for DJ60943: {'auction_closing_time': 1774714481.0, 'created_time': 1773304442.87449, 'last_price_update_time': 1774696339.427199}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ60943') HTTP/1.1" 204 0
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [auto1.de] INFO: Scrape type for YY92615: 2
2026-03-28 11:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615
2026-03-28 11:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7928b9de-98fa-5b16-83e0-e30944e8187b with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7928b9de-98fa-5b16-83e0-e30944e8187b with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7928b9de-98fa-5b16-83e0-e30944e8187b, identifier: YY92615
2026-03-28 11:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615
2026-03-28 11:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615
2026-03-28 11:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7928b9de-98fa-5b16-83e0-e30944e8187b with identifier: YY92615 to the API
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:01:32Z',
 'fuel_type': 'diesel',
 'id': '7928b9de-98fa-5b16-83e0-e30944e8187b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY92615',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 144906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-31',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2020}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [auto1.de] INFO: Saving data for YY92615: {'auction_closing_time': 1774713692.0, 'created_time': 1774294217.995412, 'last_price_update_time': 1774696339.866787}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY92615') HTTP/1.1" 204 0
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-28 11:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:19 [auto1.de] INFO: Channel: 24h | Page: 226 | totalHits: 9709 | hits on page: 40
2026-03-28 11:12:19 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [auto1.de] INFO: Scrape type for LT34656: 2
2026-03-28 11:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656
2026-03-28 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce2dca40-f721-58f7-bcb6-a8858dc1fa78, identifier: LT34656
2026-03-28 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656
2026-03-28 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656
2026-03-28 11:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce2dca40-f721-58f7-bcb6-a8858dc1fa78 with identifier: LT34656 to the API
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:39Z',
 'fuel_type': 'diesel',
 'id': 'ce2dca40-f721-58f7-bcb6-a8858dc1fa78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT34656',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 147957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Black Shadow 4x4',
 'transmission': 'manual',
 'trim': 'Black Shadow 4x4',
 'year': 2017}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [auto1.de] INFO: Saving data for LT34656: {'auction_closing_time': 1774716159.0, 'created_time': 1773831013.481671, 'last_price_update_time': 1774696340.430613}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT34656') HTTP/1.1" 204 0
2026-03-28 11:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [auto1.de] INFO: Scrape type for RX21744: 2
2026-03-28 11:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744
2026-03-28 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb, identifier: RX21744
2026-03-28 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744
2026-03-28 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744
2026-03-28 11:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1e65f0b-0d8f-5dcb-972b-bd305a595ddb with identifier: RX21744 to the API
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:20:44Z',
 'fuel_type': 'diesel',
 'id': 'b1e65f0b-0d8f-5dcb-972b-bd305a595ddb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX21744',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 277115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-17',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 e-HDi Business-Line',
 'transmission': 'automatic',
 'trim': 'Business-Line',
 'year': 2013}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [auto1.de] INFO: Saving data for RX21744: {'auction_closing_time': 1774714844.0, 'created_time': 1773429007.339156, 'last_price_update_time': 1774696340.846148}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX21744') HTTP/1.1" 204 0
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-28 11:12:20 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [auto1.de] INFO: Scrape type for WC14239: 2
2026-03-28 11:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239
2026-03-28 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21, identifier: WC14239
2026-03-28 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239
2026-03-28 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239
2026-03-28 11:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f728d3a-6c70-568d-9d02-6ed7b5d83f21 with identifier: WC14239 to the API
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:02:24Z',
 'fuel_type': 'petrol',
 'id': '1f728d3a-6c70-568d-9d02-6ed7b5d83f21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC14239',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 80783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2019}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [auto1.de] INFO: Saving data for WC14239: {'auction_closing_time': 1774713744.0, 'created_time': 1773402596.624837, 'last_price_update_time': 1774696341.341605}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC14239') HTTP/1.1" 204 0
2026-03-28 11:12:21 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-28 11:12:21 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-28 11:12:21 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [auto1.de] INFO: Scrape type for MP24640: 2
2026-03-28 11:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640
2026-03-28 11:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ace37f9f-d718-5388-a123-c681744a6d41 with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ace37f9f-d718-5388-a123-c681744a6d41 with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ace37f9f-d718-5388-a123-c681744a6d41, identifier: MP24640
2026-03-28 11:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640
2026-03-28 11:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640
2026-03-28 11:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ace37f9f-d718-5388-a123-c681744a6d41 with identifier: MP24640 to the API
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:13:57Z',
 'fuel_type': 'petrol',
 'id': 'ace37f9f-d718-5388-a123-c681744a6d41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP24640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 71741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [auto1.de] INFO: Saving data for MP24640: {'auction_closing_time': 1774714437.0, 'created_time': 1773858927.865826, 'last_price_update_time': 1774696341.926474}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP24640') HTTP/1.1" 204 0
2026-03-28 11:12:21 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [auto1.de] INFO: Scrape type for KV52621: 2
2026-03-28 11:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621
2026-03-28 11:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd5ebeff-de36-58b5-919c-e1f530f0f5c2, identifier: KV52621
2026-03-28 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621
2026-03-28 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621
2026-03-28 11:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd5ebeff-de36-58b5-919c-e1f530f0f5c2 with identifier: KV52621 to the API
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:04:03Z',
 'fuel_type': 'petrol',
 'id': 'dd5ebeff-de36-58b5-919c-e1f530f0f5c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV52621',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 171478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-28',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2011}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [auto1.de] INFO: Saving data for KV52621: {'auction_closing_time': 1774713843.0, 'created_time': 1774291108.598519, 'last_price_update_time': 1774696342.358304}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV52621') HTTP/1.1" 204 0
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [auto1.de] INFO: Scrape type for TT59921: 2
2026-03-28 11:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921
2026-03-28 11:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd8a982-625c-5cc1-9e30-0472ae648a22 with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd8a982-625c-5cc1-9e30-0472ae648a22 with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acd8a982-625c-5cc1-9e30-0472ae648a22, identifier: TT59921
2026-03-28 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921
2026-03-28 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921
2026-03-28 11:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acd8a982-625c-5cc1-9e30-0472ae648a22 with identifier: TT59921 to the API
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:28:52Z',
 'fuel_type': 'diesel',
 'id': 'acd8a982-625c-5cc1-9e30-0472ae648a22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT59921',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 226844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [auto1.de] INFO: Saving data for TT59921: {'auction_closing_time': 1774715332.0, 'created_time': 1773687239.829686, 'last_price_update_time': 1774696342.845361}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT59921') HTTP/1.1" 204 0
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-28 11:12:22 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [auto1.de] INFO: Scrape type for SR15436: 2
2026-03-28 11:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436
2026-03-28 11:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 039c0a14-9801-5631-9175-8fbdb9cb9c4f with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 039c0a14-9801-5631-9175-8fbdb9cb9c4f with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 039c0a14-9801-5631-9175-8fbdb9cb9c4f, identifier: SR15436
2026-03-28 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436
2026-03-28 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436
2026-03-28 11:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 039c0a14-9801-5631-9175-8fbdb9cb9c4f with identifier: SR15436 to the API
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:49:28Z',
 'fuel_type': 'diesel',
 'id': '039c0a14-9801-5631-9175-8fbdb9cb9c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR15436',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 149497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 d T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2019}
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [auto1.de] INFO: Saving data for SR15436: {'auction_closing_time': 1774716568.0, 'created_time': 1773402586.172188, 'last_price_update_time': 1774696343.292086}
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR15436') HTTP/1.1" 204 0
2026-03-28 11:12:23 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [auto1.de] INFO: Scrape type for FG98454: 2
2026-03-28 11:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454
2026-03-28 11:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 135badff-bd07-5ffe-bd4f-6037c314d211 with scrape type 2
2026-03-28 11:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 135badff-bd07-5ffe-bd4f-6037c314d211 with scrape type 2
2026-03-28 11:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 135badff-bd07-5ffe-bd4f-6037c314d211, identifier: FG98454
2026-03-28 11:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454
2026-03-28 11:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454
2026-03-28 11:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 135badff-bd07-5ffe-bd4f-6037c314d211 with identifier: FG98454 to the API
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:24:52Z',
 'fuel_type': 'diesel',
 'id': '135badff-bd07-5ffe-bd4f-6037c314d211',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG98454',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 282080,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-24',
 'seller_name': None,
 'title': 'Volvo V70 2.4 D Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2009}
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [auto1.de] INFO: Saving data for FG98454: {'auction_closing_time': 1774715092.0, 'created_time': 1774263790.541595, 'last_price_update_time': 1774696343.717984}
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG98454') HTTP/1.1" 204 0
2026-03-28 11:12:23 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-28 11:12:23 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-28 11:12:23 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [auto1.de] INFO: Scrape type for LZ51858: 2
2026-03-28 11:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858
2026-03-28 11:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05f35297-b75e-5716-a80f-ec691263f1ed with scrape type 2
2026-03-28 11:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05f35297-b75e-5716-a80f-ec691263f1ed with scrape type 2
2026-03-28 11:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05f35297-b75e-5716-a80f-ec691263f1ed, identifier: LZ51858
2026-03-28 11:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858
2026-03-28 11:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858
2026-03-28 11:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05f35297-b75e-5716-a80f-ec691263f1ed with identifier: LZ51858 to the API
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:14:05Z',
 'fuel_type': 'diesel',
 'id': '05f35297-b75e-5716-a80f-ec691263f1ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ51858',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 397963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-27',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [auto1.de] INFO: Saving data for LZ51858: {'auction_closing_time': 1774714445.0, 'created_time': 1773861292.230411, 'last_price_update_time': 1774696344.153329}
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ51858') HTTP/1.1" 204 0
2026-03-28 11:12:24 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [auto1.de] INFO: Scrape type for EE83336: 2
2026-03-28 11:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336
2026-03-28 11:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with scrape type 2
2026-03-28 11:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with scrape type 2
2026-03-28 11:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 772f1e3f-30a9-5257-ba44-451fe8bf54e0, identifier: EE83336
2026-03-28 11:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336
2026-03-28 11:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336
2026-03-28 11:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 772f1e3f-30a9-5257-ba44-451fe8bf54e0 with identifier: EE83336 to the API
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 129,
 'expiration_date': '2026-03-28T16:21:50Z',
 'fuel_type': 'petrol',
 'id': '772f1e3f-30a9-5257-ba44-451fe8bf54e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE83336',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4 S-Cross',
 'odometer': 71217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Suzuki SX4 S-Cross 1.4 BoosterJet Mild-Hybrid Comfort 4x4',
 'transmission': 'manual',
 'trim': 'Comfort 4x4',
 'year': 2020}
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [auto1.de] INFO: Saving data for EE83336: {'auction_closing_time': 1774714910.0, 'created_time': 1773861607.345471, 'last_price_update_time': 1774696344.690786}
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE83336') HTTP/1.1" 204 0
2026-03-28 11:12:24 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [auto1.de] INFO: Scrape type for MK68330: 2
2026-03-28 11:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330
2026-03-28 11:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48973bba-4eb7-5792-ac31-d9317f2b05dc with scrape type 2
2026-03-28 11:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48973bba-4eb7-5792-ac31-d9317f2b05dc with scrape type 2
2026-03-28 11:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48973bba-4eb7-5792-ac31-d9317f2b05dc, identifier: MK68330
2026-03-28 11:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330
2026-03-28 11:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330
2026-03-28 11:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48973bba-4eb7-5792-ac31-d9317f2b05dc with identifier: MK68330 to the API
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:39:40Z',
 'fuel_type': 'petrol',
 'id': '48973bba-4eb7-5792-ac31-d9317f2b05dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK68330',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 32237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-30',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [auto1.de] INFO: Saving data for MK68330: {'auction_closing_time': 1774715980.0, 'created_time': 1773305686.473593, 'last_price_update_time': 1774696345.123313}
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK68330') HTTP/1.1" 204 0
2026-03-28 11:12:25 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [auto1.de] INFO: Scrape type for EN87643: 2
2026-03-28 11:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643
2026-03-28 11:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with scrape type 2
2026-03-28 11:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with scrape type 2
2026-03-28 11:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc, identifier: EN87643
2026-03-28 11:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643
2026-03-28 11:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643
2026-03-28 11:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c982c84-a8cd-576e-ba63-bd456b8b2ebc with identifier: EN87643 to the API
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:04:45Z',
 'fuel_type': 'diesel',
 'id': '9c982c84-a8cd-576e-ba63-bd456b8b2ebc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN87643',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 238117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [auto1.de] INFO: Saving data for EN87643: {'auction_closing_time': 1774713885.0, 'created_time': 1774608361.892529, 'last_price_update_time': 1774696345.753098}
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN87643') HTTP/1.1" 204 0
2026-03-28 11:12:25 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-28 11:12:25 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [auto1.de] INFO: Scrape type for DL95738: 2
2026-03-28 11:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738
2026-03-28 11:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 187cd142-355a-50cf-9ea4-36b7f4144508 with scrape type 2
2026-03-28 11:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 187cd142-355a-50cf-9ea4-36b7f4144508 with scrape type 2
2026-03-28 11:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 187cd142-355a-50cf-9ea4-36b7f4144508, identifier: DL95738
2026-03-28 11:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738
2026-03-28 11:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738
2026-03-28 11:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 187cd142-355a-50cf-9ea4-36b7f4144508 with identifier: DL95738 to the API
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:51:30Z',
 'fuel_type': 'petrol',
 'id': '187cd142-355a-50cf-9ea4-36b7f4144508',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL95738',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S40',
 'odometer': 124598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-30',
 'seller_name': None,
 'title': 'Volvo S40 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [auto1.de] INFO: Saving data for DL95738: {'auction_closing_time': 1774716690.0, 'created_time': 1773688963.872421, 'last_price_update_time': 1774696346.271857}
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL95738') HTTP/1.1" 204 0
2026-03-28 11:12:26 [auto1.de] INFO: Channel: 24h | Page: 227 | totalHits: 9709 | hits on page: 40
2026-03-28 11:12:26 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-28 11:12:26 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-28 11:12:26 [auto1.de] INFO: Found listing with ID: MM87204
2026-03-28 11:12:26 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [auto1.de] INFO: Scrape type for EE47026: 2
2026-03-28 11:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026
2026-03-28 11:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09057ef2-c520-5eca-9db6-88460af5734f with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09057ef2-c520-5eca-9db6-88460af5734f with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09057ef2-c520-5eca-9db6-88460af5734f, identifier: EE47026
2026-03-28 11:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026
2026-03-28 11:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026
2026-03-28 11:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09057ef2-c520-5eca-9db6-88460af5734f with identifier: EE47026 to the API
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:14:40Z',
 'fuel_type': 'diesel',
 'id': '09057ef2-c520-5eca-9db6-88460af5734f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE47026',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 95412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-24',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI kompakt BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'kompakt BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [auto1.de] INFO: Saving data for EE47026: {'auction_closing_time': 1774714480.0, 'created_time': 1774293542.633676, 'last_price_update_time': 1774696346.717418}
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE47026') HTTP/1.1" 204 0
2026-03-28 11:12:26 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [auto1.de] INFO: Scrape type for DP87789: 2
2026-03-28 11:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789
2026-03-28 11:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681d9114-5fc1-5dbd-8986-8212c7fbac96 with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 681d9114-5fc1-5dbd-8986-8212c7fbac96 with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 681d9114-5fc1-5dbd-8986-8212c7fbac96, identifier: DP87789
2026-03-28 11:12:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:26 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-28 11:12:26 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [auto1.de] INFO: Scrape type for GE21325: 2
2026-03-28 11:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325
2026-03-28 11:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with scrape type 2
2026-03-28 11:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8, identifier: GE21325
2026-03-28 11:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789
2026-03-28 11:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789
2026-03-28 11:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 681d9114-5fc1-5dbd-8986-8212c7fbac96 with identifier: DP87789 to the API
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:42:03Z',
 'fuel_type': 'diesel',
 'id': '681d9114-5fc1-5dbd-8986-8212c7fbac96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP87789',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 50333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-28 11:12:27 [auto1.de] INFO: Saving data for DP87789: {'auction_closing_time': 1774716123.0, 'created_time': 1773402580.974435, 'last_price_update_time': 1774696347.307875}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP87789') HTTP/1.1" 204 0
2026-03-28 11:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325
2026-03-28 11:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325
2026-03-28 11:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8 with identifier: GE21325 to the API
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-28T16:21:46Z',
 'fuel_type': 'petrol',
 'id': '76732f6f-1f81-5d6f-b8ea-d9f0a8ba97c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE21325',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 46070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-03',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 T-GDI N Performance',
 'transmission': 'automatic',
 'trim': 'N Performance',
 'year': 2023}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-28 11:12:27 [auto1.de] INFO: Saving data for GE21325: {'auction_closing_time': 1774714906.0, 'created_time': 1774293452.408471, 'last_price_update_time': 1774696347.836465}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE21325') HTTP/1.1" 204 0
2026-03-28 11:12:27 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-28 11:12:27 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-28 11:12:27 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-28 11:12:27 [auto1.de] INFO: Scrape type for XS07294: 2
2026-03-28 11:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294
2026-03-28 11:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with scrape type 2
2026-03-28 11:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with scrape type 2
2026-03-28 11:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3, identifier: XS07294
2026-03-28 11:12:27 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-28 11:12:27 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-28 11:12:27 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-28 11:12:27 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-28 11:12:27 [auto1.de] INFO: Scrape type for FH64312: 2
2026-03-28 11:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312
2026-03-28 11:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with scrape type 2
2026-03-28 11:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9e61d35-35b1-593f-94ad-78ad9d1aaa23, identifier: FH64312
2026-03-28 11:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294
2026-03-28 11:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294
2026-03-28 11:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20031c62-cb95-5d60-b6e9-f9b29a1ccfa3 with identifier: XS07294 to the API
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:02:37Z',
 'fuel_type': 'diesel',
 'id': '20031c62-cb95-5d60-b6e9-f9b29a1ccfa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS07294',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 221992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'manual',
 'trim': 'Ultra',
 'year': 2017}
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [auto1.de] INFO: Saving data for XS07294: {'auction_closing_time': 1774713757.0, 'created_time': 1773773081.119513, 'last_price_update_time': 1774696348.413717}
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS07294') HTTP/1.1" 204 0
2026-03-28 11:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312
2026-03-28 11:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312
2026-03-28 11:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9e61d35-35b1-593f-94ad-78ad9d1aaa23 with identifier: FH64312 to the API
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:59:28Z',
 'fuel_type': 'diesel',
 'id': 'e9e61d35-35b1-593f-94ad-78ad9d1aaa23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH64312',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 191028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'BMW 5er 525d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [auto1.de] INFO: Saving data for FH64312: {'auction_closing_time': 1774717168.0, 'created_time': 1773305674.986573, 'last_price_update_time': 1774696348.717813}
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH64312') HTTP/1.1" 204 0
2026-03-28 11:12:28 [auto1.de] INFO: Found listing with ID: ZZ72723
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ72723%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [auto1.de] INFO: Scrape type for ZZ72723: 2
2026-03-28 11:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with identifier: ZZ72723
2026-03-28 11:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34, identifier: ZZ72723
2026-03-28 11:12:28 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-28 11:12:28 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-28 11:12:28 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [auto1.de] INFO: Scrape type for PU00921: 2
2026-03-28 11:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921
2026-03-28 11:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with scrape type 2
2026-03-28 11:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2, identifier: PU00921
2026-03-28 11:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with identifier: ZZ72723
2026-03-28 11:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with identifier: ZZ72723
2026-03-28 11:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34 with identifier: ZZ72723 to the API
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:01:02Z',
 'fuel_type': 'hybrid',
 'id': '3ce9b97a-a5b0-5f31-89ab-6d0fa2d2bd34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ72723',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 47041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ72723%27 HTTP/1.1" 200 None
2026-03-28 11:12:29 [auto1.de] INFO: Saving data for ZZ72723: {'auction_closing_time': 1774713662.0, 'created_time': 1774292310.691321, 'last_price_update_time': 1774696349.257382}
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ72723') HTTP/1.1" 204 0
2026-03-28 11:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921
2026-03-28 11:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921
2026-03-28 11:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2 with identifier: PU00921 to the API
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:56:07Z',
 'fuel_type': 'diesel',
 'id': 'c2f3328c-2f1f-55b0-a4de-dc32b80c6ae2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU00921',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 156668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-30',
 'seller_name': None,
 'title': 'Audi A4 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-28 11:12:29 [auto1.de] INFO: Saving data for PU00921: {'auction_closing_time': 1774716967.0, 'created_time': 1773302655.443431, 'last_price_update_time': 1774696349.724206}
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU00921') HTTP/1.1" 204 0
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: VX77382
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-28 11:12:29 [auto1.de] INFO: Scrape type for MR65343: 2
2026-03-28 11:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343
2026-03-28 11:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05888734-0499-5bc7-8d60-028692f55005 with scrape type 2
2026-03-28 11:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05888734-0499-5bc7-8d60-028692f55005 with scrape type 2
2026-03-28 11:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05888734-0499-5bc7-8d60-028692f55005, identifier: MR65343
2026-03-28 11:12:29 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-28 11:12:29 [auto1.de] INFO: Scrape type for CB80286: 2
2026-03-28 11:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286
2026-03-28 11:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with scrape type 2
2026-03-28 11:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with scrape type 2
2026-03-28 11:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c7b28fe-d7cf-5fd1-b6af-a22385996986, identifier: CB80286
2026-03-28 11:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343
2026-03-28 11:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343
2026-03-28 11:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05888734-0499-5bc7-8d60-028692f55005 with identifier: MR65343 to the API
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:50:44Z',
 'fuel_type': 'diesel',
 'id': '05888734-0499-5bc7-8d60-028692f55005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR65343',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 136717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-18',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2019}
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [auto1.de] INFO: Saving data for MR65343: {'auction_closing_time': 1774716644.0, 'created_time': 1773775244.873221, 'last_price_update_time': 1774696350.291042}
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR65343') HTTP/1.1" 204 0
2026-03-28 11:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286
2026-03-28 11:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286
2026-03-28 11:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c7b28fe-d7cf-5fd1-b6af-a22385996986 with identifier: CB80286 to the API
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:20:51Z',
 'fuel_type': 'diesel',
 'id': '9c7b28fe-d7cf-5fd1-b6af-a22385996986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB80286',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 237006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-16',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [auto1.de] INFO: Saving data for CB80286: {'auction_closing_time': 1774714851.0, 'created_time': 1773830157.529888, 'last_price_update_time': 1774696350.618445}
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB80286') HTTP/1.1" 204 0
2026-03-28 11:12:30 [auto1.de] INFO: Found listing with ID: DG23349
2026-03-28 11:12:30 [auto1.de] INFO: Found listing with ID: TG62557
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG62557%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [auto1.de] INFO: Scrape type for TG62557: 2
2026-03-28 11:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with identifier: TG62557
2026-03-28 11:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with scrape type 2
2026-03-28 11:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with scrape type 2
2026-03-28 11:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e, identifier: TG62557
2026-03-28 11:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with identifier: TG62557
2026-03-28 11:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with identifier: TG62557
2026-03-28 11:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d2037bb-c1c6-5a99-aedb-73c658b1b34e with identifier: TG62557 to the API
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:54:29Z',
 'fuel_type': 'petrol',
 'id': '7d2037bb-c1c6-5a99-aedb-73c658b1b34e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG62557',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 144747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-17',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 265',
 'transmission': 'automatic',
 'trim': 'Cupra 265',
 'year': 2014}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG62557%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [auto1.de] INFO: Saving data for TG62557: {'auction_closing_time': 1774716869.0, 'created_time': 1773775627.53298, 'last_price_update_time': 1774696351.301714}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG62557') HTTP/1.1" 204 0
2026-03-28 11:12:31 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [auto1.de] INFO: Scrape type for EP44160: 2
2026-03-28 11:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160
2026-03-28 11:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46ad4b93-e9f9-56bd-b711-f05364dacc0e with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46ad4b93-e9f9-56bd-b711-f05364dacc0e with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46ad4b93-e9f9-56bd-b711-f05364dacc0e, identifier: EP44160
2026-03-28 11:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160
2026-03-28 11:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160
2026-03-28 11:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46ad4b93-e9f9-56bd-b711-f05364dacc0e with identifier: EP44160 to the API
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:55:39Z',
 'fuel_type': 'petrol',
 'id': '46ad4b93-e9f9-56bd-b711-f05364dacc0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP44160',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 119025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [auto1.de] INFO: Saving data for EP44160: {'auction_closing_time': 1774716939.0, 'created_time': 1773831757.800105, 'last_price_update_time': 1774696351.77077}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP44160') HTTP/1.1" 204 0
2026-03-28 11:12:31 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [auto1.de] INFO: Scrape type for BF31444: 2
2026-03-28 11:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444
2026-03-28 11:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a, identifier: BF31444
2026-03-28 11:12:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444
2026-03-28 11:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444
2026-03-28 11:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c906807-c8b8-59bc-ab89-cf9c4ef6256a with identifier: BF31444 to the API
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:08Z',
 'fuel_type': 'petrol',
 'id': '0c906807-c8b8-59bc-ab89-cf9c4ef6256a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF31444',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kamiq',
 'odometer': 35391,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-11',
 'seller_name': None,
 'title': 'Skoda Kamiq 1.0 TSI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2022}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [auto1.de] INFO: Saving data for BF31444: {'auction_closing_time': 1774715948.0, 'created_time': 1773400122.577479, 'last_price_update_time': 1774696352.207267}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF31444') HTTP/1.1" 204 0
2026-03-28 11:12:32 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [auto1.de] INFO: Scrape type for DG34308: 2
2026-03-28 11:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308
2026-03-28 11:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce, identifier: DG34308
2026-03-28 11:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308
2026-03-28 11:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308
2026-03-28 11:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c8f0679-13f1-5bcc-a465-ab1c7e62cdce with identifier: DG34308 to the API
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:41Z',
 'fuel_type': 'petrol',
 'id': '6c8f0679-13f1-5bcc-a465-ab1c7e62cdce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG34308',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 162669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [auto1.de] INFO: Saving data for DG34308: {'auction_closing_time': 1774716041.0, 'created_time': 1773303193.409721, 'last_price_update_time': 1774696352.805859}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG34308') HTTP/1.1" 204 0
2026-03-28 11:12:32 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-28 11:12:32 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [auto1.de] INFO: Scrape type for XR37106: 2
2026-03-28 11:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106
2026-03-28 11:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e55bd07a-af40-55a0-a940-fe4573b2fb90 with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e55bd07a-af40-55a0-a940-fe4573b2fb90 with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e55bd07a-af40-55a0-a940-fe4573b2fb90, identifier: XR37106
2026-03-28 11:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106
2026-03-28 11:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106
2026-03-28 11:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e55bd07a-af40-55a0-a940-fe4573b2fb90 with identifier: XR37106 to the API
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:16:48Z',
 'fuel_type': 'diesel',
 'id': 'e55bd07a-af40-55a0-a940-fe4573b2fb90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR37106',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 24278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-22',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2024}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [auto1.de] INFO: Saving data for XR37106: {'auction_closing_time': 1774714608.0, 'created_time': 1773134625.719167, 'last_price_update_time': 1774696353.262407}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR37106') HTTP/1.1" 204 0
2026-03-28 11:12:33 [auto1.de] INFO: Channel: 24h | Page: 228 | totalHits: 9710 | hits on page: 40
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [auto1.de] INFO: Scrape type for GW52920: 2
2026-03-28 11:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920
2026-03-28 11:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15, identifier: GW52920
2026-03-28 11:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920
2026-03-28 11:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920
2026-03-28 11:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d4df8ba-03b5-5cec-ade7-dfc338b21c15 with identifier: GW52920 to the API
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:54:52Z',
 'fuel_type': 'diesel',
 'id': '7d4df8ba-03b5-5cec-ade7-dfc338b21c15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW52920',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 86205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-15',
 'seller_name': None,
 'title': 'BMW 3er 320d GT xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [auto1.de] INFO: Saving data for GW52920: {'auction_closing_time': 1774716892.0, 'created_time': 1774294780.198223, 'last_price_update_time': 1774696353.798812}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW52920') HTTP/1.1" 204 0
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [auto1.de] INFO: Scrape type for HR96195: 2
2026-03-28 11:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195
2026-03-28 11:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8156d24a-632f-5b4e-8099-b781be3d8eb2 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8156d24a-632f-5b4e-8099-b781be3d8eb2 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8156d24a-632f-5b4e-8099-b781be3d8eb2, identifier: HR96195
2026-03-28 11:12:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-28 11:12:33 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [auto1.de] INFO: Scrape type for TP63810: 2
2026-03-28 11:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810
2026-03-28 11:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 080787a8-56cb-5197-8195-0b0097879d7e with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 080787a8-56cb-5197-8195-0b0097879d7e with scrape type 2
2026-03-28 11:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 080787a8-56cb-5197-8195-0b0097879d7e, identifier: TP63810
2026-03-28 11:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195
2026-03-28 11:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195
2026-03-28 11:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8156d24a-632f-5b4e-8099-b781be3d8eb2 with identifier: HR96195 to the API
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:50:26Z',
 'fuel_type': 'petrol',
 'id': '8156d24a-632f-5b4e-8099-b781be3d8eb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR96195',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 20118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-07',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [auto1.de] INFO: Saving data for HR96195: {'auction_closing_time': 1774716626.0, 'created_time': 1774292457.00928, 'last_price_update_time': 1774696354.396036}
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR96195') HTTP/1.1" 204 0
2026-03-28 11:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810
2026-03-28 11:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810
2026-03-28 11:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 080787a8-56cb-5197-8195-0b0097879d7e with identifier: TP63810 to the API
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:25:27Z',
 'fuel_type': 'petrol',
 'id': '080787a8-56cb-5197-8195-0b0097879d7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP63810',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 68201,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-01',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [auto1.de] INFO: Saving data for TP63810: {'auction_closing_time': 1774715127.0, 'created_time': 1774293682.994105, 'last_price_update_time': 1774696354.738687}
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP63810') HTTP/1.1" 204 0
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [auto1.de] INFO: Scrape type for BZ75769: 2
2026-03-28 11:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769
2026-03-28 11:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f2497a8-6880-528b-a9a7-69d6d637626d with scrape type 2
2026-03-28 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f2497a8-6880-528b-a9a7-69d6d637626d with scrape type 2
2026-03-28 11:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f2497a8-6880-528b-a9a7-69d6d637626d, identifier: BZ75769
2026-03-28 11:12:34 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [auto1.de] INFO: Scrape type for KF41308: 2
2026-03-28 11:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308
2026-03-28 11:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 957eb23d-41ee-505f-b33e-194f71c469a8 with scrape type 2
2026-03-28 11:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 957eb23d-41ee-505f-b33e-194f71c469a8 with scrape type 2
2026-03-28 11:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 957eb23d-41ee-505f-b33e-194f71c469a8, identifier: KF41308
2026-03-28 11:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769
2026-03-28 11:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769
2026-03-28 11:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f2497a8-6880-528b-a9a7-69d6d637626d with identifier: BZ75769 to the API
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:14Z',
 'fuel_type': 'diesel',
 'id': '5f2497a8-6880-528b-a9a7-69d6d637626d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ75769',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 58745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [auto1.de] INFO: Saving data for BZ75769: {'auction_closing_time': 1774714754.0, 'created_time': 1773135803.608433, 'last_price_update_time': 1774696355.297409}
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ75769') HTTP/1.1" 204 0
2026-03-28 11:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308
2026-03-28 11:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308
2026-03-28 11:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 957eb23d-41ee-505f-b33e-194f71c469a8 with identifier: KF41308 to the API
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:25:18Z',
 'fuel_type': 'diesel',
 'id': '957eb23d-41ee-505f-b33e-194f71c469a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF41308',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 172823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L2 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '310 L2 Tourneo Titanium',
 'year': 2016}
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [auto1.de] INFO: Saving data for KF41308: {'auction_closing_time': 1774715118.0, 'created_time': 1774293587.34379, 'last_price_update_time': 1774696355.704753}
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF41308') HTTP/1.1" 204 0
2026-03-28 11:12:35 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [auto1.de] INFO: Scrape type for BN23533: 2
2026-03-28 11:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533
2026-03-28 11:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with scrape type 2
2026-03-28 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with scrape type 2
2026-03-28 11:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12, identifier: BN23533
2026-03-28 11:12:35 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [auto1.de] INFO: Scrape type for RF27065: 2
2026-03-28 11:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065
2026-03-28 11:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67315f09-84fc-51a6-941b-c423ccf4d077 with scrape type 2
2026-03-28 11:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67315f09-84fc-51a6-941b-c423ccf4d077 with scrape type 2
2026-03-28 11:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67315f09-84fc-51a6-941b-c423ccf4d077, identifier: RF27065
2026-03-28 11:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533
2026-03-28 11:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533
2026-03-28 11:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20ed1ddb-9bae-59ae-a83e-22dd22bc2f12 with identifier: BN23533 to the API
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:57:23Z',
 'fuel_type': 'petrol',
 'id': '20ed1ddb-9bae-59ae-a83e-22dd22bc2f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN23533',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 45668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2019}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Saving data for BN23533: {'auction_closing_time': 1774717043.0, 'created_time': 1773858940.22156, 'last_price_update_time': 1774696356.250787}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN23533') HTTP/1.1" 204 0
2026-03-28 11:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065
2026-03-28 11:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065
2026-03-28 11:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67315f09-84fc-51a6-941b-c423ccf4d077 with identifier: RF27065 to the API
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:17:12Z',
 'fuel_type': 'petrol',
 'id': '67315f09-84fc-51a6-941b-c423ccf4d077',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF27065',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 158589,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-25',
 'seller_name': None,
 'title': 'Hyundai i40 1.6 5 Star Edition',
 'transmission': 'manual',
 'trim': '5 Star Edition',
 'year': 2013}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Saving data for RF27065: {'auction_closing_time': 1774714632.0, 'created_time': 1773306092.223411, 'last_price_update_time': 1774696356.551199}
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF27065') HTTP/1.1" 204 0
2026-03-28 11:12:36 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Scrape type for KL73476: 2
2026-03-28 11:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476
2026-03-28 11:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 947a2bc2-30d5-52e0-b58e-c45210405414 with scrape type 2
2026-03-28 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 947a2bc2-30d5-52e0-b58e-c45210405414 with scrape type 2
2026-03-28 11:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 947a2bc2-30d5-52e0-b58e-c45210405414, identifier: KL73476
2026-03-28 11:12:36 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-28 11:12:36 [auto1.de] INFO: Scrape type for MM04767: 2
2026-03-28 11:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767
2026-03-28 11:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42669363-fad3-5798-b87e-c2fb0ecf5665 with scrape type 2
2026-03-28 11:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42669363-fad3-5798-b87e-c2fb0ecf5665 with scrape type 2
2026-03-28 11:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42669363-fad3-5798-b87e-c2fb0ecf5665, identifier: MM04767
2026-03-28 11:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476
2026-03-28 11:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476
2026-03-28 11:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 947a2bc2-30d5-52e0-b58e-c45210405414 with identifier: KL73476 to the API
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:09:59Z',
 'fuel_type': 'petrol',
 'id': '947a2bc2-30d5-52e0-b58e-c45210405414',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL73476',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 178375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-13',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 Exception 2009',
 'transmission': 'manual',
 'trim': 'Exception 2009',
 'year': 2009}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Saving data for KL73476: {'auction_closing_time': 1774714199.0, 'created_time': 1773383116.479284, 'last_price_update_time': 1774696357.062729}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL73476') HTTP/1.1" 204 0
2026-03-28 11:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767
2026-03-28 11:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767
2026-03-28 11:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42669363-fad3-5798-b87e-c2fb0ecf5665 with identifier: MM04767 to the API
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:29:19Z',
 'fuel_type': 'petrol',
 'id': '42669363-fad3-5798-b87e-c2fb0ecf5665',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM04767',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 115141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-31',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2012}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Saving data for MM04767: {'auction_closing_time': 1774715359.0, 'created_time': 1774294718.697982, 'last_price_update_time': 1774696357.366847}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM04767') HTTP/1.1" 204 0
2026-03-28 11:12:37 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Scrape type for UF45337: 2
2026-03-28 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337
2026-03-28 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 849444f1-0b58-52fc-9dd5-7e9570ffec46 with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 849444f1-0b58-52fc-9dd5-7e9570ffec46 with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 849444f1-0b58-52fc-9dd5-7e9570ffec46, identifier: UF45337
2026-03-28 11:12:37 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Scrape type for AJ13004: 2
2026-03-28 11:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004
2026-03-28 11:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2650f5b-4934-5021-821b-9935d661cf49 with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2650f5b-4934-5021-821b-9935d661cf49 with scrape type 2
2026-03-28 11:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2650f5b-4934-5021-821b-9935d661cf49, identifier: AJ13004
2026-03-28 11:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337
2026-03-28 11:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337
2026-03-28 11:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 849444f1-0b58-52fc-9dd5-7e9570ffec46 with identifier: UF45337 to the API
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 167,
 'expiration_date': '2026-03-28T16:54:25Z',
 'fuel_type': 'petrol',
 'id': '849444f1-0b58-52fc-9dd5-7e9570ffec46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF45337',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Coupe',
 'odometer': 160218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-25',
 'seller_name': None,
 'title': 'Hyundai Coupe 2.7 V6 GLS',
 'transmission': 'automatic',
 'trim': 'GLS',
 'year': 2006}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [auto1.de] INFO: Saving data for UF45337: {'auction_closing_time': 1774716865.0, 'created_time': 1773306921.670261, 'last_price_update_time': 1774696357.91843}
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF45337') HTTP/1.1" 204 0
2026-03-28 11:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004
2026-03-28 11:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004
2026-03-28 11:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2650f5b-4934-5021-821b-9935d661cf49 with identifier: AJ13004 to the API
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:28:56Z',
 'fuel_type': 'petrol',
 'id': 'd2650f5b-4934-5021-821b-9935d661cf49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ13004',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 125993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-29',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [auto1.de] INFO: Saving data for AJ13004: {'auction_closing_time': 1774715336.0, 'created_time': 1772543367.94763, 'last_price_update_time': 1774696358.280745}
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ13004') HTTP/1.1" 204 0
2026-03-28 11:12:38 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-28 11:12:38 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-28 11:12:38 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-28 11:12:38 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [auto1.de] INFO: Scrape type for DB09685: 2
2026-03-28 11:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685
2026-03-28 11:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12da426-c89b-5f2a-bb11-2542b05274d6 with scrape type 2
2026-03-28 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12da426-c89b-5f2a-bb11-2542b05274d6 with scrape type 2
2026-03-28 11:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e12da426-c89b-5f2a-bb11-2542b05274d6, identifier: DB09685
2026-03-28 11:12:38 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [auto1.de] INFO: Scrape type for WG69866: 2
2026-03-28 11:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866
2026-03-28 11:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e12cb2a1-a2fe-534d-b4fb-81d35620c92c with scrape type 2
2026-03-28 11:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e12cb2a1-a2fe-534d-b4fb-81d35620c92c with scrape type 2
2026-03-28 11:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e12cb2a1-a2fe-534d-b4fb-81d35620c92c, identifier: WG69866
2026-03-28 11:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685
2026-03-28 11:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685
2026-03-28 11:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e12da426-c89b-5f2a-bb11-2542b05274d6 with identifier: DB09685 to the API
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:38:42Z',
 'fuel_type': 'diesel',
 'id': 'e12da426-c89b-5f2a-bb11-2542b05274d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB09685',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 137843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-30',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Spirit 4WD',
 'transmission': 'manual',
 'trim': 'Spirit 4WD',
 'year': 2015}
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [auto1.de] INFO: Saving data for DB09685: {'auction_closing_time': 1774715922.0, 'created_time': 1774293566.586896, 'last_price_update_time': 1774696358.830356}
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB09685') HTTP/1.1" 204 0
2026-03-28 11:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866
2026-03-28 11:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866
2026-03-28 11:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e12cb2a1-a2fe-534d-b4fb-81d35620c92c with identifier: WG69866 to the API
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:54:55Z',
 'fuel_type': 'diesel',
 'id': 'e12cb2a1-a2fe-534d-b4fb-81d35620c92c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG69866',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 114723,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [auto1.de] INFO: Saving data for WG69866: {'auction_closing_time': 1774716895.0, 'created_time': 1773688809.985888, 'last_price_update_time': 1774696359.257923}
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG69866') HTTP/1.1" 204 0
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [auto1.de] INFO: Scrape type for DA75557: 2
2026-03-28 11:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557
2026-03-28 11:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8dabb7f-ded5-5444-a559-3f45af3439c4 with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8dabb7f-ded5-5444-a559-3f45af3439c4 with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8dabb7f-ded5-5444-a559-3f45af3439c4, identifier: DA75557
2026-03-28 11:12:39 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [auto1.de] INFO: Scrape type for UT93934: 2
2026-03-28 11:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934
2026-03-28 11:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca787e8-bbb9-5c5e-9aad-c874b48cb593 with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eca787e8-bbb9-5c5e-9aad-c874b48cb593 with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eca787e8-bbb9-5c5e-9aad-c874b48cb593, identifier: UT93934
2026-03-28 11:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557
2026-03-28 11:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557
2026-03-28 11:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8dabb7f-ded5-5444-a559-3f45af3439c4 with identifier: DA75557 to the API
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:48Z',
 'fuel_type': 'petrol',
 'id': 'a8dabb7f-ded5-5444-a559-3f45af3439c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA75557',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 234444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-09',
 'seller_name': None,
 'title': 'Skoda Superb 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [auto1.de] INFO: Saving data for DA75557: {'auction_closing_time': 1774713768.0, 'created_time': 1773860993.879053, 'last_price_update_time': 1774696359.85242}
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA75557') HTTP/1.1" 204 0
2026-03-28 11:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934
2026-03-28 11:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934
2026-03-28 11:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eca787e8-bbb9-5c5e-9aad-c874b48cb593 with identifier: UT93934 to the API
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:05:02Z',
 'fuel_type': 'petrol',
 'id': 'eca787e8-bbb9-5c5e-9aad-c874b48cb593',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT93934',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 40607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-01',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2022}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [auto1.de] INFO: Saving data for UT93934: {'auction_closing_time': 1774713902.0, 'created_time': 1773308013.532886, 'last_price_update_time': 1774696360.202587}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT93934') HTTP/1.1" 204 0
2026-03-28 11:12:40 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [auto1.de] INFO: Scrape type for RH12349: 2
2026-03-28 11:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349
2026-03-28 11:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with scrape type 2
2026-03-28 11:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with scrape type 2
2026-03-28 11:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0, identifier: RH12349
2026-03-28 11:12:40 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [auto1.de] INFO: Scrape type for DJ80434: 2
2026-03-28 11:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434
2026-03-28 11:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with scrape type 2
2026-03-28 11:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with scrape type 2
2026-03-28 11:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e, identifier: DJ80434
2026-03-28 11:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349
2026-03-28 11:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349
2026-03-28 11:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adeca68a-a85c-5d02-bffd-c3f1ac7d1db0 with identifier: RH12349 to the API
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:03:00Z',
 'fuel_type': 'petrol',
 'id': 'adeca68a-a85c-5d02-bffd-c3f1ac7d1db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH12349',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 116615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-02-12',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Special 4x4',
 'transmission': 'manual',
 'trim': 'Special 4x4',
 'year': 2001}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [auto1.de] INFO: Saving data for RH12349: {'auction_closing_time': 1774713780.0, 'created_time': 1773343815.463306, 'last_price_update_time': 1774696360.758132}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH12349') HTTP/1.1" 204 0
2026-03-28 11:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434
2026-03-28 11:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434
2026-03-28 11:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 289ee44b-35a2-5b13-bbc6-fdac120b2f7e with identifier: DJ80434 to the API
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:57:39Z',
 'fuel_type': 'diesel',
 'id': '289ee44b-35a2-5b13-bbc6-fdac120b2f7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ80434',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 282273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-06',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-28 11:12:41 [auto1.de] INFO: Saving data for DJ80434: {'auction_closing_time': 1774717059.0, 'created_time': 1774264339.259533, 'last_price_update_time': 1774696361.057378}
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ80434') HTTP/1.1" 204 0
2026-03-28 11:12:41 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-28 11:12:41 [auto1.de] INFO: Scrape type for JJ83769: 2
2026-03-28 11:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769
2026-03-28 11:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with scrape type 2
2026-03-28 11:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with scrape type 2
2026-03-28 11:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc, identifier: JJ83769
2026-03-28 11:12:41 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-28 11:12:41 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-28 11:12:41 [auto1.de] INFO: Scrape type for UJ55086: 2
2026-03-28 11:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086
2026-03-28 11:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with scrape type 2
2026-03-28 11:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with scrape type 2
2026-03-28 11:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34, identifier: UJ55086
2026-03-28 11:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769
2026-03-28 11:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769
2026-03-28 11:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc with identifier: JJ83769 to the API
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:50:33Z',
 'fuel_type': 'diesel',
 'id': '8d6d3bd3-96b8-5be0-8b5e-93f19b8905dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ83769',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 227076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-08',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-28 11:12:41 [auto1.de] INFO: Saving data for JJ83769: {'auction_closing_time': 1774716633.0, 'created_time': 1773775704.465636, 'last_price_update_time': 1774696361.604107}
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JJ83769') HTTP/1.1" 204 0
2026-03-28 11:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086
2026-03-28 11:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086
2026-03-28 11:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34 with identifier: UJ55086 to the API
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:10:15Z',
 'fuel_type': 'diesel',
 'id': 'e081d4f2-403b-5f7d-99ce-ec3dfdbc8f34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ55086',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 239166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-13',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2010}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Saving data for UJ55086: {'auction_closing_time': 1774714215.0, 'created_time': 1773380972.326889, 'last_price_update_time': 1774696362.016748}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ55086') HTTP/1.1" 204 0
2026-03-28 11:12:42 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Scrape type for EW68189: 2
2026-03-28 11:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189
2026-03-28 11:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f3f1ae1-20c1-58f8-af34-8247319d0ada with scrape type 2
2026-03-28 11:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f3f1ae1-20c1-58f8-af34-8247319d0ada with scrape type 2
2026-03-28 11:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f3f1ae1-20c1-58f8-af34-8247319d0ada, identifier: EW68189
2026-03-28 11:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:42 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Scrape type for FH45720: 2
2026-03-28 11:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720
2026-03-28 11:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 628d424a-e2b7-5244-8333-ca3a03d2c587 with scrape type 2
2026-03-28 11:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 628d424a-e2b7-5244-8333-ca3a03d2c587 with scrape type 2
2026-03-28 11:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 628d424a-e2b7-5244-8333-ca3a03d2c587, identifier: FH45720
2026-03-28 11:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189
2026-03-28 11:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189
2026-03-28 11:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f3f1ae1-20c1-58f8-af34-8247319d0ada with identifier: EW68189 to the API
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:33:47Z',
 'fuel_type': 'petrol',
 'id': '7f3f1ae1-20c1-58f8-af34-8247319d0ada',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW68189',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 120296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-20',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4',
 'transmission': 'manual',
 'trim': 'ALL4',
 'year': 2011}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Saving data for EW68189: {'auction_closing_time': 1774715627.0, 'created_time': 1773427083.243122, 'last_price_update_time': 1774696362.604239}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW68189') HTTP/1.1" 204 0
2026-03-28 11:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720
2026-03-28 11:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720
2026-03-28 11:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 628d424a-e2b7-5244-8333-ca3a03d2c587 with identifier: FH45720 to the API
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:56:07Z',
 'fuel_type': 'diesel',
 'id': '628d424a-e2b7-5244-8333-ca3a03d2c587',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH45720',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 226990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-14',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2010}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Saving data for FH45720: {'auction_closing_time': 1774716967.0, 'created_time': 1774293346.592066, 'last_price_update_time': 1774696362.950312}
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH45720') HTTP/1.1" 204 0
2026-03-28 11:12:42 [auto1.de] INFO: Found listing with ID: NN07588
2026-03-28 11:12:42 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [auto1.de] INFO: Scrape type for NA20314: 2
2026-03-28 11:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314
2026-03-28 11:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875a4a15-d927-5e75-b325-d151c808c644 with scrape type 2
2026-03-28 11:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875a4a15-d927-5e75-b325-d151c808c644 with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875a4a15-d927-5e75-b325-d151c808c644, identifier: NA20314
2026-03-28 11:12:43 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-28 11:12:43 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Scrape type for FA96638: 2
2026-03-28 11:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638
2026-03-28 11:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb479ad5-39ea-51e7-ae4c-96d684216893 with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb479ad5-39ea-51e7-ae4c-96d684216893 with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb479ad5-39ea-51e7-ae4c-96d684216893, identifier: FA96638
2026-03-28 11:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314
2026-03-28 11:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314
2026-03-28 11:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875a4a15-d927-5e75-b325-d151c808c644 with identifier: NA20314 to the API
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-28T16:20:10Z',
 'fuel_type': 'petrol',
 'id': '875a4a15-d927-5e75-b325-d151c808c644',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA20314',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 83295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2015}
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Saving data for NA20314: {'auction_closing_time': 1774714810.0, 'created_time': 1773687381.827153, 'last_price_update_time': 1774696363.496804}
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA20314') HTTP/1.1" 204 0
2026-03-28 11:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638
2026-03-28 11:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638
2026-03-28 11:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb479ad5-39ea-51e7-ae4c-96d684216893 with identifier: FA96638 to the API
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:43:44Z',
 'fuel_type': 'petrol',
 'id': 'cb479ad5-39ea-51e7-ae4c-96d684216893',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA96638',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 137198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-11',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2014}
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Saving data for FA96638: {'auction_closing_time': 1774716224.0, 'created_time': 1774608435.155741, 'last_price_update_time': 1774696363.814438}
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA96638') HTTP/1.1" 204 0
2026-03-28 11:12:43 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-28 11:12:43 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Scrape type for JV29717: 2
2026-03-28 11:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717
2026-03-28 11:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37cbefa3-116c-527d-bd73-7fd02a8ea455 with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 37cbefa3-116c-527d-bd73-7fd02a8ea455 with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37cbefa3-116c-527d-bd73-7fd02a8ea455, identifier: JV29717
2026-03-28 11:12:43 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [auto1.de] INFO: Scrape type for AK47916: 2
2026-03-28 11:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916
2026-03-28 11:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item febbbca0-2805-5891-b32d-eb10306c292e with scrape type 2
2026-03-28 11:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item febbbca0-2805-5891-b32d-eb10306c292e with scrape type 2
2026-03-28 11:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: febbbca0-2805-5891-b32d-eb10306c292e, identifier: AK47916
2026-03-28 11:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717
2026-03-28 11:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717
2026-03-28 11:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37cbefa3-116c-527d-bd73-7fd02a8ea455 with identifier: JV29717 to the API
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:18:18Z',
 'fuel_type': 'diesel',
 'id': '37cbefa3-116c-527d-bd73-7fd02a8ea455',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV29717',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 191465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-21',
 'seller_name': None,
 'title': 'BMW X3 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-28 11:12:44 [auto1.de] INFO: Saving data for JV29717: {'auction_closing_time': 1774714698.0, 'created_time': 1774608510.180632, 'last_price_update_time': 1774696364.360806}
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV29717') HTTP/1.1" 204 0
2026-03-28 11:12:44 [auto1.de] INFO: Channel: 24h | Page: 229 | totalHits: 9710 | hits on page: 40
2026-03-28 11:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916
2026-03-28 11:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916
2026-03-28 11:12:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: febbbca0-2805-5891-b32d-eb10306c292e with identifier: AK47916 to the API
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:32Z',
 'fuel_type': 'diesel',
 'id': 'febbbca0-2805-5891-b32d-eb10306c292e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK47916',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 300529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-16',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2008}
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-28 11:12:44 [auto1.de] INFO: Saving data for AK47916: {'auction_closing_time': 1774715192.0, 'created_time': 1773306517.625499, 'last_price_update_time': 1774696364.681264}
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK47916') HTTP/1.1" 204 0
2026-03-28 11:12:44 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-28 11:12:44 [auto1.de] INFO: Scrape type for DG61616: 2
2026-03-28 11:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616
2026-03-28 11:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7859677f-fbf3-55c2-a7eb-bf191be718de with scrape type 2
2026-03-28 11:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7859677f-fbf3-55c2-a7eb-bf191be718de with scrape type 2
2026-03-28 11:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7859677f-fbf3-55c2-a7eb-bf191be718de, identifier: DG61616
2026-03-28 11:12:44 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-28 11:12:44 [auto1.de] INFO: Scrape type for MX66491: 2
2026-03-28 11:12:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491
2026-03-28 11:12:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e581117a-baca-5bcb-806f-ad276e8acf31 with scrape type 2
2026-03-28 11:12:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e581117a-baca-5bcb-806f-ad276e8acf31 with scrape type 2
2026-03-28 11:12:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e581117a-baca-5bcb-806f-ad276e8acf31, identifier: MX66491
2026-03-28 11:12:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616
2026-03-28 11:12:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616
2026-03-28 11:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7859677f-fbf3-55c2-a7eb-bf191be718de with identifier: DG61616 to the API
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:45:23Z',
 'fuel_type': 'petrol',
 'id': '7859677f-fbf3-55c2-a7eb-bf191be718de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG61616',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 46593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-30',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2020}
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-28 11:12:45 [auto1.de] INFO: Saving data for DG61616: {'auction_closing_time': 1774716323.0, 'created_time': 1773346017.777766, 'last_price_update_time': 1774696365.267879}
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG61616') HTTP/1.1" 204 0
2026-03-28 11:12:45 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-28 11:12:45 [auto1.de] INFO: Scrape type for DD09602: 2
2026-03-28 11:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602
2026-03-28 11:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b34d1d-206d-54dc-9a84-cc44e958c5eb with scrape type 2
2026-03-28 11:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6b34d1d-206d-54dc-9a84-cc44e958c5eb with scrape type 2
2026-03-28 11:12:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6b34d1d-206d-54dc-9a84-cc44e958c5eb, identifier: DD09602
2026-03-28 11:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491
2026-03-28 11:12:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491
2026-03-28 11:12:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e581117a-baca-5bcb-806f-ad276e8acf31 with identifier: MX66491 to the API
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:06:22Z',
 'fuel_type': 'petrol',
 'id': 'e581117a-baca-5bcb-806f-ad276e8acf31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX66491',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 41093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-07',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 220 4Matic Urban',
 'transmission': 'automatic',
 'trim': '4Matic Urban',
 'year': 2015}
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-28 11:12:45 [auto1.de] INFO: Saving data for MX66491: {'auction_closing_time': 1774713982.0, 'created_time': 1773689000.738637, 'last_price_update_time': 1774696365.868726}
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX66491') HTTP/1.1" 204 0
2026-03-28 11:12:45 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-28 11:12:45 [auto1.de] INFO: Scrape type for SA96746: 2
2026-03-28 11:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746
2026-03-28 11:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c34e5599-ba6f-5240-a887-6b4cfbb9a79f with scrape type 2
2026-03-28 11:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c34e5599-ba6f-5240-a887-6b4cfbb9a79f with scrape type 2
2026-03-28 11:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c34e5599-ba6f-5240-a887-6b4cfbb9a79f, identifier: SA96746
2026-03-28 11:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602
2026-03-28 11:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602
2026-03-28 11:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6b34d1d-206d-54dc-9a84-cc44e958c5eb with identifier: DD09602 to the API
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:12:17Z',
 'fuel_type': 'diesel',
 'id': 'f6b34d1d-206d-54dc-9a84-cc44e958c5eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD09602',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 171680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-05',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2015}
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-28 11:12:46 [auto1.de] INFO: Saving data for DD09602: {'auction_closing_time': 1774714337.0, 'created_time': 1774294105.08387, 'last_price_update_time': 1774696366.465488}
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD09602') HTTP/1.1" 204 0
2026-03-28 11:12:46 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-28 11:12:46 [auto1.de] INFO: Scrape type for JV68298: 2
2026-03-28 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298
2026-03-28 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with scrape type 2
2026-03-28 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with scrape type 2
2026-03-28 11:12:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a38d0bc1-b543-5df0-ba0f-dd8d970ce090, identifier: JV68298
2026-03-28 11:12:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746
2026-03-28 11:12:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746
2026-03-28 11:12:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c34e5599-ba6f-5240-a887-6b4cfbb9a79f with identifier: SA96746 to the API
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:57:56Z',
 'fuel_type': 'hybrid',
 'id': 'c34e5599-ba6f-5240-a887-6b4cfbb9a79f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA96746',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 21082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-29',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2022}
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-28 11:12:46 [auto1.de] INFO: Saving data for SA96746: {'auction_closing_time': 1774717076.0, 'created_time': 1773307197.38271, 'last_price_update_time': 1774696366.945345}
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA96746') HTTP/1.1" 204 0
2026-03-28 11:12:46 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-28 11:12:46 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-28 11:12:46 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-28 11:12:46 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-28 11:12:46 [auto1.de] INFO: Scrape type for YV35353: 2
2026-03-28 11:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353
2026-03-28 11:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6758c1aa-38a5-55bf-b3f4-f95362269df5 with scrape type 2
2026-03-28 11:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6758c1aa-38a5-55bf-b3f4-f95362269df5 with scrape type 2
2026-03-28 11:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6758c1aa-38a5-55bf-b3f4-f95362269df5, identifier: YV35353
2026-03-28 11:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298
2026-03-28 11:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298
2026-03-28 11:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a38d0bc1-b543-5df0-ba0f-dd8d970ce090 with identifier: JV68298 to the API
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:56:37Z',
 'fuel_type': 'diesel',
 'id': 'a38d0bc1-b543-5df0-ba0f-dd8d970ce090',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV68298',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 271058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Match',
 'transmission': 'automatic',
 'trim': 'Match',
 'year': 2012}
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-28 11:12:47 [auto1.de] INFO: Saving data for JV68298: {'auction_closing_time': 1774716997.0, 'created_time': 1773861457.989313, 'last_price_update_time': 1774696367.417969}
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV68298') HTTP/1.1" 204 0
2026-03-28 11:12:47 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-28 11:12:47 [auto1.de] INFO: Scrape type for YU15721: 2
2026-03-28 11:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721
2026-03-28 11:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6516615b-3391-5455-89b1-ecd93cdcf4db with scrape type 2
2026-03-28 11:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6516615b-3391-5455-89b1-ecd93cdcf4db with scrape type 2
2026-03-28 11:12:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6516615b-3391-5455-89b1-ecd93cdcf4db, identifier: YU15721
2026-03-28 11:12:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353
2026-03-28 11:12:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353
2026-03-28 11:12:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6758c1aa-38a5-55bf-b3f4-f95362269df5 with identifier: YV35353 to the API
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:05:51Z',
 'fuel_type': 'petrol',
 'id': '6758c1aa-38a5-55bf-b3f4-f95362269df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV35353',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 161693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-03',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-28 11:12:47 [auto1.de] INFO: Saving data for YV35353: {'auction_closing_time': 1774713951.0, 'created_time': 1773308217.977507, 'last_price_update_time': 1774696367.920731}
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV35353') HTTP/1.1" 204 0
2026-03-28 11:12:47 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-28 11:12:47 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-28 11:12:47 [auto1.de] INFO: Scrape type for JY05464: 2
2026-03-28 11:12:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464
2026-03-28 11:12:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8054ab-1784-523a-a320-ceb93a6639a2 with scrape type 2
2026-03-28 11:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8054ab-1784-523a-a320-ceb93a6639a2 with scrape type 2
2026-03-28 11:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8054ab-1784-523a-a320-ceb93a6639a2, identifier: JY05464
2026-03-28 11:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721
2026-03-28 11:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721
2026-03-28 11:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6516615b-3391-5455-89b1-ecd93cdcf4db with identifier: YU15721 to the API
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:09:52Z',
 'fuel_type': 'petrol',
 'id': '6516615b-3391-5455-89b1-ecd93cdcf4db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU15721',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 57801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-07',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Trend blue',
 'transmission': 'manual',
 'trim': 'Trend blue',
 'year': 2016}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [auto1.de] INFO: Saving data for YU15721: {'auction_closing_time': 1774714192.0, 'created_time': 1773859133.93996, 'last_price_update_time': 1774696368.368893}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU15721') HTTP/1.1" 204 0
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: RY40991
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [auto1.de] INFO: Scrape type for ML35786: 2
2026-03-28 11:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786
2026-03-28 11:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86d26b60-c34d-531f-beaa-f624ea762118 with scrape type 2
2026-03-28 11:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86d26b60-c34d-531f-beaa-f624ea762118 with scrape type 2
2026-03-28 11:12:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86d26b60-c34d-531f-beaa-f624ea762118, identifier: ML35786
2026-03-28 11:12:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464
2026-03-28 11:12:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464
2026-03-28 11:12:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8054ab-1784-523a-a320-ceb93a6639a2 with identifier: JY05464 to the API
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:44:31Z',
 'fuel_type': 'petrol',
 'id': '2a8054ab-1784-523a-a320-ceb93a6639a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY05464',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 59633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [auto1.de] INFO: Saving data for JY05464: {'auction_closing_time': 1774716271.0, 'created_time': 1773303380.819313, 'last_price_update_time': 1774696368.796957}
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY05464') HTTP/1.1" 204 0
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-28 11:12:48 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [auto1.de] INFO: Scrape type for TX40728: 2
2026-03-28 11:12:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728
2026-03-28 11:12:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af5d53ca-6e7e-55c4-8aa7-221903807e9f with scrape type 2
2026-03-28 11:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af5d53ca-6e7e-55c4-8aa7-221903807e9f with scrape type 2
2026-03-28 11:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af5d53ca-6e7e-55c4-8aa7-221903807e9f, identifier: TX40728
2026-03-28 11:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786
2026-03-28 11:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786
2026-03-28 11:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86d26b60-c34d-531f-beaa-f624ea762118 with identifier: ML35786 to the API
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:38:34Z',
 'fuel_type': 'diesel',
 'id': '86d26b60-c34d-531f-beaa-f624ea762118',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML35786',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 421767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-10',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [auto1.de] INFO: Saving data for ML35786: {'auction_closing_time': 1774715914.0, 'created_time': 1773401361.049885, 'last_price_update_time': 1774696369.338187}
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML35786') HTTP/1.1" 204 0
2026-03-28 11:12:49 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [auto1.de] INFO: Scrape type for HR96195: 0
2026-03-28 11:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728
2026-03-28 11:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728
2026-03-28 11:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af5d53ca-6e7e-55c4-8aa7-221903807e9f with identifier: TX40728 to the API
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:11:07Z',
 'fuel_type': 'hybrid',
 'id': 'af5d53ca-6e7e-55c4-8aa7-221903807e9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX40728',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 26280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-16',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 de T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [auto1.de] INFO: Saving data for TX40728: {'auction_closing_time': 1774714267.0, 'created_time': 1773687758.105501, 'last_price_update_time': 1774696369.66971}
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX40728') HTTP/1.1" 204 0
2026-03-28 11:12:49 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-28 11:12:49 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [auto1.de] INFO: Scrape type for XJ97474: 2
2026-03-28 11:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474
2026-03-28 11:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acd7d930-180b-51c7-a3dc-6c7306376516 with scrape type 2
2026-03-28 11:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acd7d930-180b-51c7-a3dc-6c7306376516 with scrape type 2
2026-03-28 11:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acd7d930-180b-51c7-a3dc-6c7306376516, identifier: XJ97474
2026-03-28 11:12:49 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [auto1.de] INFO: Scrape type for UG67799: 2
2026-03-28 11:12:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799
2026-03-28 11:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a09ef76-c396-5292-8f73-c549689bd410 with scrape type 2
2026-03-28 11:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a09ef76-c396-5292-8f73-c549689bd410 with scrape type 2
2026-03-28 11:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a09ef76-c396-5292-8f73-c549689bd410, identifier: UG67799
2026-03-28 11:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474
2026-03-28 11:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474
2026-03-28 11:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acd7d930-180b-51c7-a3dc-6c7306376516 with identifier: XJ97474 to the API
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:05:58Z',
 'fuel_type': 'petrol',
 'id': 'acd7d930-180b-51c7-a3dc-6c7306376516',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ97474',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 161860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-28',
 'seller_name': None,
 'title': 'BMW 3er 335i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [auto1.de] INFO: Saving data for XJ97474: {'auction_closing_time': 1774713958.0, 'created_time': 1773830191.200506, 'last_price_update_time': 1774696370.227955}
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ97474') HTTP/1.1" 204 0
2026-03-28 11:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799
2026-03-28 11:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799
2026-03-28 11:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a09ef76-c396-5292-8f73-c549689bd410 with identifier: UG67799 to the API
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:13:24Z',
 'fuel_type': 'petrol',
 'id': '6a09ef76-c396-5292-8f73-c549689bd410',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG67799',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 135663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [auto1.de] INFO: Saving data for UG67799: {'auction_closing_time': 1774714404.0, 'created_time': 1774293382.272049, 'last_price_update_time': 1774696370.543928}
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG67799') HTTP/1.1" 204 0
2026-03-28 11:12:50 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [auto1.de] INFO: Scrape type for DG85302: 2
2026-03-28 11:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302
2026-03-28 11:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82bae6de-11ef-5a42-9e9b-934600f12292 with scrape type 2
2026-03-28 11:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82bae6de-11ef-5a42-9e9b-934600f12292 with scrape type 2
2026-03-28 11:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82bae6de-11ef-5a42-9e9b-934600f12292, identifier: DG85302
2026-03-28 11:12:50 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [auto1.de] INFO: Scrape type for SJ84971: 2
2026-03-28 11:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971
2026-03-28 11:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb75be63-9b9f-5b0c-abff-6533d296129b with scrape type 2
2026-03-28 11:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb75be63-9b9f-5b0c-abff-6533d296129b with scrape type 2
2026-03-28 11:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb75be63-9b9f-5b0c-abff-6533d296129b, identifier: SJ84971
2026-03-28 11:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302
2026-03-28 11:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302
2026-03-28 11:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82bae6de-11ef-5a42-9e9b-934600f12292 with identifier: DG85302 to the API
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:19:42Z',
 'fuel_type': 'petrol',
 'id': '82bae6de-11ef-5a42-9e9b-934600f12292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG85302',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 189761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-31',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Njoy mit Style-Paket',
 'transmission': 'manual',
 'trim': 'Njoy mit Style-Paket',
 'year': 2005}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-28 11:12:51 [auto1.de] INFO: Saving data for DG85302: {'auction_closing_time': 1774714782.0, 'created_time': 1774119106.916775, 'last_price_update_time': 1774696371.089941}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG85302') HTTP/1.1" 204 0
2026-03-28 11:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971
2026-03-28 11:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971
2026-03-28 11:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb75be63-9b9f-5b0c-abff-6533d296129b with identifier: SJ84971 to the API
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:45:06Z',
 'fuel_type': 'diesel',
 'id': 'fb75be63-9b9f-5b0c-abff-6533d296129b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ84971',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 102769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-10',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Edition ecoFlex',
 'transmission': 'manual',
 'trim': 'Edition ecoFlex',
 'year': 2017}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-28 11:12:51 [auto1.de] INFO: Saving data for SJ84971: {'auction_closing_time': 1774716306.0, 'created_time': 1773831066.268847, 'last_price_update_time': 1774696371.430279}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ84971') HTTP/1.1" 204 0
2026-03-28 11:12:51 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-28 11:12:51 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-28 11:12:51 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-28 11:12:51 [auto1.de] INFO: Scrape type for XY91338: 2
2026-03-28 11:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338
2026-03-28 11:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59e0c513-ccc4-5e57-9334-661cf7013330 with scrape type 2
2026-03-28 11:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59e0c513-ccc4-5e57-9334-661cf7013330 with scrape type 2
2026-03-28 11:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59e0c513-ccc4-5e57-9334-661cf7013330, identifier: XY91338
2026-03-28 11:12:51 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-28 11:12:51 [auto1.de] INFO: Scrape type for HA98136: 2
2026-03-28 11:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136
2026-03-28 11:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with scrape type 2
2026-03-28 11:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with scrape type 2
2026-03-28 11:12:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017, identifier: HA98136
2026-03-28 11:12:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338
2026-03-28 11:12:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338
2026-03-28 11:12:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59e0c513-ccc4-5e57-9334-661cf7013330 with identifier: XY91338 to the API
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:08:46Z',
 'fuel_type': 'diesel',
 'id': '59e0c513-ccc4-5e57-9334-661cf7013330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY91338',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 140507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-05',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-28 11:12:51 [auto1.de] INFO: Saving data for XY91338: {'auction_closing_time': 1774714126.0, 'created_time': 1773402132.286524, 'last_price_update_time': 1774696371.949095}
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY91338') HTTP/1.1" 204 0
2026-03-28 11:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136
2026-03-28 11:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136
2026-03-28 11:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02ed9ec5-b2fe-5d1f-be32-8b653bbed017 with identifier: HA98136 to the API
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:17:33Z',
 'fuel_type': 'diesel',
 'id': '02ed9ec5-b2fe-5d1f-be32-8b653bbed017',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA98136',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 168235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-29',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2013}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [auto1.de] INFO: Saving data for HA98136: {'auction_closing_time': 1774714653.0, 'created_time': 1774294619.554806, 'last_price_update_time': 1774696372.378513}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA98136') HTTP/1.1" 204 0
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [auto1.de] INFO: Scrape type for TX92660: 2
2026-03-28 11:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660
2026-03-28 11:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aeddfba2-250f-53ba-94e2-ab2cad133537 with scrape type 2
2026-03-28 11:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aeddfba2-250f-53ba-94e2-ab2cad133537 with scrape type 2
2026-03-28 11:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aeddfba2-250f-53ba-94e2-ab2cad133537, identifier: TX92660
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-28 11:12:52 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [auto1.de] INFO: Scrape type for NZ72675: 2
2026-03-28 11:12:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675
2026-03-28 11:12:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b691e249-a160-5e5a-b294-f25dca43bf91 with scrape type 2
2026-03-28 11:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b691e249-a160-5e5a-b294-f25dca43bf91 with scrape type 2
2026-03-28 11:12:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b691e249-a160-5e5a-b294-f25dca43bf91, identifier: NZ72675
2026-03-28 11:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660
2026-03-28 11:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660
2026-03-28 11:12:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aeddfba2-250f-53ba-94e2-ab2cad133537 with identifier: TX92660 to the API
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:41:05Z',
 'fuel_type': 'diesel',
 'id': 'aeddfba2-250f-53ba-94e2-ab2cad133537',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX92660',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 187595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-06',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2009}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [auto1.de] INFO: Saving data for TX92660: {'auction_closing_time': 1774716065.0, 'created_time': 1773302854.033142, 'last_price_update_time': 1774696372.945291}
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX92660') HTTP/1.1" 204 0
2026-03-28 11:12:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675
2026-03-28 11:12:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675
2026-03-28 11:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b691e249-a160-5e5a-b294-f25dca43bf91 with identifier: NZ72675 to the API
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:57:48Z',
 'fuel_type': 'diesel',
 'id': 'b691e249-a160-5e5a-b294-f25dca43bf91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ72675',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 65341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2024}
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [auto1.de] INFO: Saving data for NZ72675: {'auction_closing_time': 1774717068.0, 'created_time': 1774291613.56682, 'last_price_update_time': 1774696373.258942}
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ72675') HTTP/1.1" 204 0
2026-03-28 11:12:53 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-28 11:12:53 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-28 11:12:53 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [auto1.de] INFO: Scrape type for PZ33404: 2
2026-03-28 11:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404
2026-03-28 11:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd00e2f0-2ede-5f93-9455-2fc8e143f02c with scrape type 2
2026-03-28 11:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd00e2f0-2ede-5f93-9455-2fc8e143f02c with scrape type 2
2026-03-28 11:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd00e2f0-2ede-5f93-9455-2fc8e143f02c, identifier: PZ33404
2026-03-28 11:12:53 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [auto1.de] INFO: Scrape type for TY32384: 2
2026-03-28 11:12:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384
2026-03-28 11:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da369dc-a854-54dd-943f-c54b415c679d with scrape type 2
2026-03-28 11:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da369dc-a854-54dd-943f-c54b415c679d with scrape type 2
2026-03-28 11:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5da369dc-a854-54dd-943f-c54b415c679d, identifier: TY32384
2026-03-28 11:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404
2026-03-28 11:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404
2026-03-28 11:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd00e2f0-2ede-5f93-9455-2fc8e143f02c with identifier: PZ33404 to the API
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:00:10Z',
 'fuel_type': 'petrol',
 'id': 'dd00e2f0-2ede-5f93-9455-2fc8e143f02c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ33404',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Exeo',
 'odometer': 214317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-09',
 'seller_name': None,
 'title': 'Seat Exeo 2.0 TFSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2010}
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [auto1.de] INFO: Saving data for PZ33404: {'auction_closing_time': 1774713610.0, 'created_time': 1774294800.553846, 'last_price_update_time': 1774696373.825168}
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ33404') HTTP/1.1" 204 0
2026-03-28 11:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384
2026-03-28 11:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384
2026-03-28 11:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5da369dc-a854-54dd-943f-c54b415c679d with identifier: TY32384 to the API
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:14:08Z',
 'fuel_type': 'diesel',
 'id': '5da369dc-a854-54dd-943f-c54b415c679d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY32384',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 119640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-02',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.2 D-4D Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2012}
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [auto1.de] INFO: Saving data for TY32384: {'auction_closing_time': 1774714448.0, 'created_time': 1773401550.580781, 'last_price_update_time': 1774696374.293521}
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY32384') HTTP/1.1" 204 0
2026-03-28 11:12:54 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [auto1.de] INFO: Scrape type for LL15014: 2
2026-03-28 11:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014
2026-03-28 11:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b448859e-8e9a-53a2-954f-5e189449354a with scrape type 2
2026-03-28 11:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b448859e-8e9a-53a2-954f-5e189449354a with scrape type 2
2026-03-28 11:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b448859e-8e9a-53a2-954f-5e189449354a, identifier: LL15014
2026-03-28 11:12:54 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [auto1.de] INFO: Scrape type for KG20268: 2
2026-03-28 11:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268
2026-03-28 11:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c0292a8-1cdd-5161-9343-12aaca46971a with scrape type 2
2026-03-28 11:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c0292a8-1cdd-5161-9343-12aaca46971a with scrape type 2
2026-03-28 11:12:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c0292a8-1cdd-5161-9343-12aaca46971a, identifier: KG20268
2026-03-28 11:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014
2026-03-28 11:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014
2026-03-28 11:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b448859e-8e9a-53a2-954f-5e189449354a with identifier: LL15014 to the API
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-28T16:44:04Z',
 'fuel_type': 'petrol',
 'id': 'b448859e-8e9a-53a2-954f-5e189449354a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL15014',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 116582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-31',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 400 T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2016}
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [auto1.de] INFO: Saving data for LL15014: {'auction_closing_time': 1774716244.0, 'created_time': 1774263259.556536, 'last_price_update_time': 1774696374.876435}
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL15014') HTTP/1.1" 204 0
2026-03-28 11:12:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268
2026-03-28 11:12:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268
2026-03-28 11:12:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c0292a8-1cdd-5161-9343-12aaca46971a with identifier: KG20268 to the API
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:30:28Z',
 'fuel_type': 'petrol',
 'id': '1c0292a8-1cdd-5161-9343-12aaca46971a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG20268',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 48309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Mirror',
 'transmission': 'manual',
 'trim': 'Mirror',
 'year': 2017}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [auto1.de] INFO: Saving data for KG20268: {'auction_closing_time': 1774715428.0, 'created_time': 1773401724.32914, 'last_price_update_time': 1774696375.180399}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG20268') HTTP/1.1" 204 0
2026-03-28 11:12:55 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [auto1.de] INFO: Scrape type for ZU03053: 2
2026-03-28 11:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053
2026-03-28 11:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 665825aa-3344-5885-a048-7d3ebcfaa2f8 with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 665825aa-3344-5885-a048-7d3ebcfaa2f8 with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 665825aa-3344-5885-a048-7d3ebcfaa2f8, identifier: ZU03053
2026-03-28 11:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:12:55 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-28 11:12:55 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-28 11:12:55 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [auto1.de] INFO: Scrape type for LL81874: 2
2026-03-28 11:12:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874
2026-03-28 11:12:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25831bd8-eef7-5b83-a637-be43c91607ba with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25831bd8-eef7-5b83-a637-be43c91607ba with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25831bd8-eef7-5b83-a637-be43c91607ba, identifier: LL81874
2026-03-28 11:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053
2026-03-28 11:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053
2026-03-28 11:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 665825aa-3344-5885-a048-7d3ebcfaa2f8 with identifier: ZU03053 to the API
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:54:57Z',
 'fuel_type': 'petrol',
 'id': '665825aa-3344-5885-a048-7d3ebcfaa2f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU03053',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 123084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [auto1.de] INFO: Saving data for ZU03053: {'auction_closing_time': 1774716897.0, 'created_time': 1774290985.241422, 'last_price_update_time': 1774696375.755654}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU03053') HTTP/1.1" 204 0
2026-03-28 11:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874
2026-03-28 11:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874
2026-03-28 11:12:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25831bd8-eef7-5b83-a637-be43c91607ba with identifier: LL81874 to the API
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:04:50Z',
 'fuel_type': 'diesel',
 'id': '25831bd8-eef7-5b83-a637-be43c91607ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL81874',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T4 Multivan',
 'odometer': 409958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-09-17',
 'seller_name': None,
 'title': 'Volkswagen T4 Multivan 2.5 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 1996}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Saving data for LL81874: {'auction_closing_time': 1774713890.0, 'created_time': 1773686861.975982, 'last_price_update_time': 1774696376.089255}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL81874') HTTP/1.1" 204 0
2026-03-28 11:12:56 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-28 11:12:56 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Scrape type for VK31305: 2
2026-03-28 11:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305
2026-03-28 11:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with scrape type 2
2026-03-28 11:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with scrape type 2
2026-03-28 11:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c, identifier: VK31305
2026-03-28 11:12:56 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Scrape type for RF75953: 2
2026-03-28 11:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953
2026-03-28 11:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f702ad-eca1-511f-8f88-30b790758684 with scrape type 2
2026-03-28 11:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f702ad-eca1-511f-8f88-30b790758684 with scrape type 2
2026-03-28 11:12:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36f702ad-eca1-511f-8f88-30b790758684, identifier: RF75953
2026-03-28 11:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305
2026-03-28 11:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305
2026-03-28 11:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1201c46e-9f17-5bdc-88aa-a87f1c48e62c with identifier: VK31305 to the API
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:47:07Z',
 'fuel_type': 'diesel',
 'id': '1201c46e-9f17-5bdc-88aa-a87f1c48e62c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK31305',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 48707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-23',
 'seller_name': None,
 'title': 'BMW 1er 120d xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2023}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Saving data for VK31305: {'auction_closing_time': 1774716427.0, 'created_time': 1773646543.711592, 'last_price_update_time': 1774696376.64662}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK31305') HTTP/1.1" 204 0
2026-03-28 11:12:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953
2026-03-28 11:12:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953
2026-03-28 11:12:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36f702ad-eca1-511f-8f88-30b790758684 with identifier: RF75953 to the API
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-28T16:10:17Z',
 'fuel_type': 'diesel',
 'id': '36f702ad-eca1-511f-8f88-30b790758684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF75953',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 100382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-22',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Saving data for RF75953: {'auction_closing_time': 1774714217.0, 'created_time': 1773303160.999371, 'last_price_update_time': 1774696376.952903}
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF75953') HTTP/1.1" 204 0
2026-03-28 11:12:56 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-28 11:12:56 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-28 11:12:56 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-28 11:12:56 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-28 11:12:56 [auto1.de] INFO: Scrape type for XU56450: 2
2026-03-28 11:12:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450
2026-03-28 11:12:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93dd912f-6f28-5c89-8314-eed5972696df with scrape type 2
2026-03-28 11:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93dd912f-6f28-5c89-8314-eed5972696df with scrape type 2
2026-03-28 11:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93dd912f-6f28-5c89-8314-eed5972696df, identifier: XU56450
2026-03-28 11:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450
2026-03-28 11:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450
2026-03-28 11:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93dd912f-6f28-5c89-8314-eed5972696df with identifier: XU56450 to the API
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:42:10Z',
 'fuel_type': 'gas',
 'id': '93dd912f-6f28-5c89-8314-eed5972696df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU56450',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 222655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-24',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 Kasten Economy EcoFuel',
 'transmission': 'manual',
 'trim': 'Kasten Economy EcoFuel',
 'year': 2008}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-28 11:12:57 [auto1.de] INFO: Saving data for XU56450: {'auction_closing_time': 1774716130.0, 'created_time': 1773308232.649924, 'last_price_update_time': 1774696377.37297}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU56450') HTTP/1.1" 204 0
2026-03-28 11:12:57 [auto1.de] INFO: Channel: 24h | Page: 230 | totalHits: 9711 | hits on page: 40
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-28 11:12:57 [auto1.de] INFO: Scrape type for BC73225: 2
2026-03-28 11:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225
2026-03-28 11:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with scrape type 2
2026-03-28 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with scrape type 2
2026-03-28 11:12:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70, identifier: BC73225
2026-03-28 11:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225
2026-03-28 11:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225
2026-03-28 11:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a8a59fe-ffb6-5ce6-9098-02878aa44e70 with identifier: BC73225 to the API
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:42:09Z',
 'fuel_type': 'petrol',
 'id': '2a8a59fe-ffb6-5ce6-9098-02878aa44e70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC73225',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Kalos',
 'odometer': 39472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-18',
 'seller_name': None,
 'title': 'Chevrolet Kalos 1.4 SX',
 'transmission': 'manual',
 'trim': 'SX',
 'year': 2009}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-28 11:12:57 [auto1.de] INFO: Saving data for BC73225: {'auction_closing_time': 1774716129.0, 'created_time': 1773380475.076288, 'last_price_update_time': 1774696377.916255}
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC73225') HTTP/1.1" 204 0
2026-03-28 11:12:57 [auto1.de] INFO: Found listing with ID: WA42896
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42896%27 HTTP/1.1" 200 None
2026-03-28 11:12:57 [auto1.de] INFO: Scrape type for WA42896: 2
2026-03-28 11:12:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896
2026-03-28 11:12:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 280acc8c-df16-54fe-bc89-53e055223745 with scrape type 2
2026-03-28 11:12:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 280acc8c-df16-54fe-bc89-53e055223745 with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 280acc8c-df16-54fe-bc89-53e055223745, identifier: WA42896
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: WA42896
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42896%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [auto1.de] INFO: Scrape type for WA42896: 2
2026-03-28 11:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 280acc8c-df16-54fe-bc89-53e055223745 with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 280acc8c-df16-54fe-bc89-53e055223745 with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 280acc8c-df16-54fe-bc89-53e055223745, identifier: WA42896
2026-03-28 11:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896
2026-03-28 11:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896
2026-03-28 11:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896 to the API
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:59:14Z',
 'fuel_type': 'hybrid',
 'id': '280acc8c-df16-54fe-bc89-53e055223745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA42896',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 96269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Toyota Prius 1.8 Plug-in Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2019}
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42896%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [auto1.de] INFO: Saving data for WA42896: {'auction_closing_time': 1774717154.0, 'created_time': 1773831126.268902, 'last_price_update_time': 1774696378.607799}
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA42896') HTTP/1.1" 204 0
2026-03-28 11:12:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896
2026-03-28 11:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896
2026-03-28 11:12:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 280acc8c-df16-54fe-bc89-53e055223745 with identifier: WA42896 to the API
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:59:14Z',
 'fuel_type': 'hybrid',
 'id': '280acc8c-df16-54fe-bc89-53e055223745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA42896',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 96269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Toyota Prius 1.8 Plug-in Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2019}
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42896%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [auto1.de] INFO: Saving data for WA42896: {'auction_closing_time': 1774717154.0, 'created_time': 1773831126.268902, 'last_price_update_time': 1774696378.915626}
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA42896') HTTP/1.1" 204 0
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-28 11:12:58 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [auto1.de] INFO: Scrape type for EG39576: 2
2026-03-28 11:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576
2026-03-28 11:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f2292a-f4d8-5729-99d8-caa5d157734e with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f2292a-f4d8-5729-99d8-caa5d157734e with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36f2292a-f4d8-5729-99d8-caa5d157734e, identifier: EG39576
2026-03-28 11:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576
2026-03-28 11:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576
2026-03-28 11:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36f2292a-f4d8-5729-99d8-caa5d157734e with identifier: EG39576 to the API
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:49:11Z',
 'fuel_type': 'diesel',
 'id': '36f2292a-f4d8-5729-99d8-caa5d157734e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG39576',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 229839,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-11',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition 4x4',
 'transmission': 'automatic',
 'trim': 'Ambition 4x4',
 'year': 2018}
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [auto1.de] INFO: Saving data for EG39576: {'auction_closing_time': 1774716551.0, 'created_time': 1773861470.681562, 'last_price_update_time': 1774696379.348147}
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG39576') HTTP/1.1" 204 0
2026-03-28 11:12:59 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-28 11:12:59 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-28 11:12:59 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-28 11:12:59 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [auto1.de] INFO: Scrape type for WP15063: 2
2026-03-28 11:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063
2026-03-28 11:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ac52a7-84a1-5052-94a9-288b655f7ab4 with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6ac52a7-84a1-5052-94a9-288b655f7ab4 with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6ac52a7-84a1-5052-94a9-288b655f7ab4, identifier: WP15063
2026-03-28 11:12:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063
2026-03-28 11:12:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063
2026-03-28 11:12:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6ac52a7-84a1-5052-94a9-288b655f7ab4 with identifier: WP15063 to the API
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:12:26Z',
 'fuel_type': 'petrol',
 'id': 'b6ac52a7-84a1-5052-94a9-288b655f7ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP15063',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 144777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-06',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2005}
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [auto1.de] INFO: Saving data for WP15063: {'auction_closing_time': 1774714346.0, 'created_time': 1774263787.076058, 'last_price_update_time': 1774696379.883163}
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP15063') HTTP/1.1" 204 0
2026-03-28 11:12:59 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [auto1.de] INFO: Scrape type for UE87725: 2
2026-03-28 11:12:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725
2026-03-28 11:12:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with scrape type 2
2026-03-28 11:12:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with scrape type 2
2026-03-28 11:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3, identifier: UE87725
2026-03-28 11:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725
2026-03-28 11:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725
2026-03-28 11:13:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25ce90e7-3ccc-5aad-9400-42c2f91eb8a3 with identifier: UE87725 to the API
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:24:47Z',
 'fuel_type': 'diesel',
 'id': '25ce90e7-3ccc-5aad-9400-42c2f91eb8a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE87725',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 138325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-30',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-28 11:13:00 [auto1.de] INFO: Saving data for UE87725: {'auction_closing_time': 1774715087.0, 'created_time': 1774265145.58714, 'last_price_update_time': 1774696380.355382}
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE87725') HTTP/1.1" 204 0
2026-03-28 11:13:00 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-28 11:13:00 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-28 11:13:00 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-28 11:13:00 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-28 11:13:00 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-28 11:13:00 [auto1.de] INFO: Scrape type for BD92511: 2
2026-03-28 11:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511
2026-03-28 11:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 950e75ad-f261-501d-92bb-cb2887c9412d with scrape type 2
2026-03-28 11:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 950e75ad-f261-501d-92bb-cb2887c9412d with scrape type 2
2026-03-28 11:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 950e75ad-f261-501d-92bb-cb2887c9412d, identifier: BD92511
2026-03-28 11:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511
2026-03-28 11:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511
2026-03-28 11:13:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 950e75ad-f261-501d-92bb-cb2887c9412d with identifier: BD92511 to the API
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:01:17Z',
 'fuel_type': 'diesel',
 'id': '950e75ad-f261-501d-92bb-cb2887c9412d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD92511',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 192950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-26',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-28 11:13:00 [auto1.de] INFO: Saving data for BD92511: {'auction_closing_time': 1774713677.0, 'created_time': 1774292544.509362, 'last_price_update_time': 1774696380.760807}
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD92511') HTTP/1.1" 204 0
2026-03-28 11:13:00 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-28 11:13:00 [auto1.de] INFO: Scrape type for VC64340: 2
2026-03-28 11:13:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340
2026-03-28 11:13:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 228be84a-1d2d-5ff7-ada2-26968542c436 with scrape type 2
2026-03-28 11:13:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 228be84a-1d2d-5ff7-ada2-26968542c436 with scrape type 2
2026-03-28 11:13:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 228be84a-1d2d-5ff7-ada2-26968542c436, identifier: VC64340
2026-03-28 11:13:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340
2026-03-28 11:13:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340
2026-03-28 11:13:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 228be84a-1d2d-5ff7-ada2-26968542c436 with identifier: VC64340 to the API
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:50:53Z',
 'fuel_type': 'diesel',
 'id': '228be84a-1d2d-5ff7-ada2-26968542c436',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC64340',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 168868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-23',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-28 11:13:01 [auto1.de] INFO: Saving data for VC64340: {'auction_closing_time': 1774716653.0, 'created_time': 1773383411.053913, 'last_price_update_time': 1774696381.295404}
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC64340') HTTP/1.1" 204 0
2026-03-28 11:13:01 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-28 11:13:01 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-28 11:13:01 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-28 11:13:01 [auto1.de] INFO: Scrape type for BB57132: 2
2026-03-28 11:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132
2026-03-28 11:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with scrape type 2
2026-03-28 11:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with scrape type 2
2026-03-28 11:13:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f, identifier: BB57132
2026-03-28 11:13:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132
2026-03-28 11:13:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132
2026-03-28 11:13:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 382b96ba-cfd1-5b9e-b3ae-87896a477e7f with identifier: BB57132 to the API
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:16:00Z',
 'fuel_type': 'diesel',
 'id': '382b96ba-cfd1-5b9e-b3ae-87896a477e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB57132',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 139997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-21',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-28 11:13:01 [auto1.de] INFO: Saving data for BB57132: {'auction_closing_time': 1774714560.0, 'created_time': 1773307517.033165, 'last_price_update_time': 1774696381.883787}
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB57132') HTTP/1.1" 204 0
2026-03-28 11:13:01 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-28 11:13:01 [auto1.de] INFO: Scrape type for AV32823: 2
2026-03-28 11:13:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823
2026-03-28 11:13:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8b3f80-d2ce-575a-a690-2a29462954e4 with scrape type 2
2026-03-28 11:13:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8b3f80-d2ce-575a-a690-2a29462954e4 with scrape type 2
2026-03-28 11:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef8b3f80-d2ce-575a-a690-2a29462954e4, identifier: AV32823
2026-03-28 11:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823
2026-03-28 11:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823
2026-03-28 11:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef8b3f80-d2ce-575a-a690-2a29462954e4 with identifier: AV32823 to the API
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:36:21Z',
 'fuel_type': 'petrol',
 'id': 'ef8b3f80-d2ce-575a-a690-2a29462954e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV32823',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 80531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-28 11:13:02 [auto1.de] INFO: Saving data for AV32823: {'auction_closing_time': 1774715781.0, 'created_time': 1773553392.869484, 'last_price_update_time': 1774696382.323652}
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV32823') HTTP/1.1" 204 0
2026-03-28 11:13:02 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-28 11:13:02 [auto1.de] INFO: Scrape type for AR39544: 2
2026-03-28 11:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544
2026-03-28 11:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001cbd09-e9c2-5254-841c-b49df085b02d with scrape type 2
2026-03-28 11:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 001cbd09-e9c2-5254-841c-b49df085b02d with scrape type 2
2026-03-28 11:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 001cbd09-e9c2-5254-841c-b49df085b02d, identifier: AR39544
2026-03-28 11:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544
2026-03-28 11:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544
2026-03-28 11:13:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 001cbd09-e9c2-5254-841c-b49df085b02d with identifier: AR39544 to the API
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:45:08Z',
 'fuel_type': 'petrol',
 'id': '001cbd09-e9c2-5254-841c-b49df085b02d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR39544',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 105441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Classic blue 2WD',
 'transmission': 'manual',
 'trim': 'Classic blue 2WD',
 'year': 2016}
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-28 11:13:02 [auto1.de] INFO: Saving data for AR39544: {'auction_closing_time': 1774716308.0, 'created_time': 1774293623.500901, 'last_price_update_time': 1774696382.793526}
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR39544') HTTP/1.1" 204 0
2026-03-28 11:13:02 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-28 11:13:02 [auto1.de] INFO: Scrape type for UC84662: 2
2026-03-28 11:13:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662
2026-03-28 11:13:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 690a8572-9671-584a-9f20-74789ae9bec4 with scrape type 2
2026-03-28 11:13:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 690a8572-9671-584a-9f20-74789ae9bec4 with scrape type 2
2026-03-28 11:13:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 690a8572-9671-584a-9f20-74789ae9bec4, identifier: UC84662
2026-03-28 11:13:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662
2026-03-28 11:13:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662
2026-03-28 11:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 690a8572-9671-584a-9f20-74789ae9bec4 with identifier: UC84662 to the API
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:49:25Z',
 'fuel_type': 'hybrid',
 'id': '690a8572-9671-584a-9f20-74789ae9bec4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC84662',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 115269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-28 11:13:03 [auto1.de] INFO: Saving data for UC84662: {'auction_closing_time': 1774716565.0, 'created_time': 1774290998.447253, 'last_price_update_time': 1774696383.199626}
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC84662') HTTP/1.1" 204 0
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-28 11:13:03 [auto1.de] INFO: Scrape type for TE93454: 2
2026-03-28 11:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454
2026-03-28 11:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with scrape type 2
2026-03-28 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with scrape type 2
2026-03-28 11:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead, identifier: TE93454
2026-03-28 11:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454
2026-03-28 11:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454
2026-03-28 11:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead with identifier: TE93454 to the API
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:56:09Z',
 'fuel_type': 'petrol',
 'id': 'ab8f7b6a-54ce-52b1-aa3d-af0f2fae1ead',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE93454',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 106676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-28 11:13:03 [auto1.de] INFO: Saving data for TE93454: {'auction_closing_time': 1774716969.0, 'created_time': 1773687927.697873, 'last_price_update_time': 1774696383.675024}
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE93454') HTTP/1.1" 204 0
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-28 11:13:03 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-28 11:13:03 [auto1.de] INFO: Scrape type for ZR21062: 2
2026-03-28 11:13:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062
2026-03-28 11:13:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90e540df-e4e6-5de2-9ee0-8d97839ac699 with scrape type 2
2026-03-28 11:13:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90e540df-e4e6-5de2-9ee0-8d97839ac699 with scrape type 2
2026-03-28 11:13:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90e540df-e4e6-5de2-9ee0-8d97839ac699, identifier: ZR21062
2026-03-28 11:13:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062
2026-03-28 11:13:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062
2026-03-28 11:13:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90e540df-e4e6-5de2-9ee0-8d97839ac699 with identifier: ZR21062 to the API
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:26Z',
 'fuel_type': 'diesel',
 'id': '90e540df-e4e6-5de2-9ee0-8d97839ac699',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR21062',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 243381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-30',
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Edition',
 'transmission': 'manual',
 'trim': 'EfficientDynamics Edition',
 'year': 2011}
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-28 11:13:04 [auto1.de] INFO: Saving data for ZR21062: {'auction_closing_time': 1774715186.0, 'created_time': 1774291963.81644, 'last_price_update_time': 1774696384.099509}
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR21062') HTTP/1.1" 204 0
2026-03-28 11:13:04 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-28 11:13:04 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-28 11:13:04 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-28 11:13:04 [auto1.de] INFO: Scrape type for KY14800: 2
2026-03-28 11:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800
2026-03-28 11:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with scrape type 2
2026-03-28 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with scrape type 2
2026-03-28 11:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a, identifier: KY14800
2026-03-28 11:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800
2026-03-28 11:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800
2026-03-28 11:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21b862dc-a0e5-522d-8fdb-fc7118f6ad2a with identifier: KY14800 to the API
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:01:54Z',
 'fuel_type': 'petrol',
 'id': '21b862dc-a0e5-522d-8fdb-fc7118f6ad2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY14800',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 124071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-03',
 'seller_name': None,
 'title': 'Audi A6 55 TFSI Mild-Hybrid quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2020}
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-28 11:13:04 [auto1.de] INFO: Saving data for KY14800: {'auction_closing_time': 1774713714.0, 'created_time': 1773383156.081231, 'last_price_update_time': 1774696384.56239}
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY14800') HTTP/1.1" 204 0
2026-03-28 11:13:04 [auto1.de] INFO: Channel: 24h | Page: 231 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:04 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-28 11:13:04 [auto1.de] INFO: Scrape type for UK28152: 2
2026-03-28 11:13:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152
2026-03-28 11:13:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with scrape type 2
2026-03-28 11:13:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with scrape type 2
2026-03-28 11:13:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 070edb50-ff92-5b9f-a8a9-3d4f41aef509, identifier: UK28152
2026-03-28 11:13:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152
2026-03-28 11:13:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152
2026-03-28 11:13:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 070edb50-ff92-5b9f-a8a9-3d4f41aef509 with identifier: UK28152 to the API
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:27:55Z',
 'fuel_type': 'petrol',
 'id': '070edb50-ff92-5b9f-a8a9-3d4f41aef509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK28152',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 123669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.4 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2009}
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-28 11:13:05 [auto1.de] INFO: Saving data for UK28152: {'auction_closing_time': 1774715275.0, 'created_time': 1774293401.032985, 'last_price_update_time': 1774696385.09061}
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK28152') HTTP/1.1" 204 0
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: LB73186
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-28 11:13:05 [auto1.de] INFO: Scrape type for WE65713: 2
2026-03-28 11:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713
2026-03-28 11:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f328ce28-1ef9-5fc2-b973-1c08e853dc14 with scrape type 2
2026-03-28 11:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f328ce28-1ef9-5fc2-b973-1c08e853dc14 with scrape type 2
2026-03-28 11:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f328ce28-1ef9-5fc2-b973-1c08e853dc14, identifier: WE65713
2026-03-28 11:13:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:05 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-28 11:13:05 [auto1.de] INFO: Scrape type for RV94916: 2
2026-03-28 11:13:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916
2026-03-28 11:13:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with scrape type 2
2026-03-28 11:13:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with scrape type 2
2026-03-28 11:13:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d, identifier: RV94916
2026-03-28 11:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713
2026-03-28 11:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713
2026-03-28 11:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f328ce28-1ef9-5fc2-b973-1c08e853dc14 with identifier: WE65713 to the API
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:53:33Z',
 'fuel_type': 'petrol',
 'id': 'f328ce28-1ef9-5fc2-b973-1c08e853dc14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE65713',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 107995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-28 11:13:05 [auto1.de] INFO: Saving data for WE65713: {'auction_closing_time': 1774716813.0, 'created_time': 1773383274.734436, 'last_price_update_time': 1774696385.682532}
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE65713') HTTP/1.1" 204 0
2026-03-28 11:13:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916
2026-03-28 11:13:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916
2026-03-28 11:13:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c14711c9-e4f8-5529-9c11-dbeca5fc1b4d with identifier: RV94916 to the API
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:04:37Z',
 'fuel_type': 'petrol',
 'id': 'c14711c9-e4f8-5529-9c11-dbeca5fc1b4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV94916',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 138725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2013}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-28 11:13:06 [auto1.de] INFO: Saving data for RV94916: {'auction_closing_time': 1774713877.0, 'created_time': 1773307705.810263, 'last_price_update_time': 1774696386.013664}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV94916') HTTP/1.1" 204 0
2026-03-28 11:13:06 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-28 11:13:06 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-28 11:13:06 [auto1.de] INFO: Scrape type for ZY93547: 2
2026-03-28 11:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547
2026-03-28 11:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with scrape type 2
2026-03-28 11:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with scrape type 2
2026-03-28 11:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb, identifier: ZY93547
2026-03-28 11:13:06 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-28 11:13:06 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-28 11:13:06 [auto1.de] INFO: Scrape type for UZ90215: 2
2026-03-28 11:13:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215
2026-03-28 11:13:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe053552-3315-56c8-bbd8-1bc54e34e7ae with scrape type 2
2026-03-28 11:13:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe053552-3315-56c8-bbd8-1bc54e34e7ae with scrape type 2
2026-03-28 11:13:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe053552-3315-56c8-bbd8-1bc54e34e7ae, identifier: UZ90215
2026-03-28 11:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547
2026-03-28 11:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547
2026-03-28 11:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ae146cf-7f04-5b2e-b308-fd145b35ddfb with identifier: ZY93547 to the API
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:33Z',
 'fuel_type': 'petrol',
 'id': '3ae146cf-7f04-5b2e-b308-fd145b35ddfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY93547',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 59267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-03',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-28 11:13:06 [auto1.de] INFO: Saving data for ZY93547: {'auction_closing_time': 1774714413.0, 'created_time': 1773830309.988095, 'last_price_update_time': 1774696386.617797}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY93547') HTTP/1.1" 204 0
2026-03-28 11:13:06 [scrapy.extensions.logstats] INFO: Crawled 447 pages (at 6 pages/min), scraped 883 items (at 126 items/min)
2026-03-28 11:13:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:13:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215
2026-03-28 11:13:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215
2026-03-28 11:13:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe053552-3315-56c8-bbd8-1bc54e34e7ae with identifier: UZ90215 to the API
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:30:28Z',
 'fuel_type': 'petrol',
 'id': 'fe053552-3315-56c8-bbd8-1bc54e34e7ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ90215',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30i xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-28 11:13:06 [auto1.de] INFO: Saving data for UZ90215: {'auction_closing_time': 1774715428.0, 'created_time': 1773774006.999903, 'last_price_update_time': 1774696386.965053}
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ90215') HTTP/1.1" 204 0
2026-03-28 11:13:06 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-28 11:13:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-28 11:13:07 [auto1.de] INFO: Scrape type for YH44643: 2
2026-03-28 11:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643
2026-03-28 11:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with scrape type 2
2026-03-28 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with scrape type 2
2026-03-28 11:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39e0e204-c581-50ff-a6d4-9e7c2b92be50, identifier: YH44643
2026-03-28 11:13:07 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-28 11:13:07 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-28 11:13:07 [auto1.de] INFO: Scrape type for CZ08846: 2
2026-03-28 11:13:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846
2026-03-28 11:13:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bb34ff7-682c-530c-81a5-fee68133c246 with scrape type 2
2026-03-28 11:13:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bb34ff7-682c-530c-81a5-fee68133c246 with scrape type 2
2026-03-28 11:13:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bb34ff7-682c-530c-81a5-fee68133c246, identifier: CZ08846
2026-03-28 11:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643
2026-03-28 11:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643
2026-03-28 11:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39e0e204-c581-50ff-a6d4-9e7c2b92be50 with identifier: YH44643 to the API
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:21:33Z',
 'fuel_type': 'petrol',
 'id': '39e0e204-c581-50ff-a6d4-9e7c2b92be50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH44643',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 88326,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-19',
 'seller_name': None,
 'title': 'Ford S-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-28 11:13:07 [auto1.de] INFO: Saving data for YH44643: {'auction_closing_time': 1774714893.0, 'created_time': 1774262620.755654, 'last_price_update_time': 1774696387.550715}
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH44643') HTTP/1.1" 204 0
2026-03-28 11:13:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846
2026-03-28 11:13:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846
2026-03-28 11:13:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bb34ff7-682c-530c-81a5-fee68133c246 with identifier: CZ08846 to the API
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:16:48Z',
 'fuel_type': 'petrol',
 'id': '4bb34ff7-682c-530c-81a5-fee68133c246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ08846',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 48174,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2017}
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-28 11:13:07 [auto1.de] INFO: Saving data for CZ08846: {'auction_closing_time': 1774714608.0, 'created_time': 1773380482.275538, 'last_price_update_time': 1774696387.999117}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ08846') HTTP/1.1" 204 0
2026-03-28 11:13:08 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-28 11:13:08 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Scrape type for FS06029: 2
2026-03-28 11:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029
2026-03-28 11:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db44d376-ccb5-5dfc-97a7-3802a6813b36 with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db44d376-ccb5-5dfc-97a7-3802a6813b36 with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db44d376-ccb5-5dfc-97a7-3802a6813b36, identifier: FS06029
2026-03-28 11:13:08 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Scrape type for RW84791: 2
2026-03-28 11:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791
2026-03-28 11:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec0771a0-fadd-589a-8c26-6732aeac7bcd with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec0771a0-fadd-589a-8c26-6732aeac7bcd with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec0771a0-fadd-589a-8c26-6732aeac7bcd, identifier: RW84791
2026-03-28 11:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029
2026-03-28 11:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029
2026-03-28 11:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db44d376-ccb5-5dfc-97a7-3802a6813b36 with identifier: FS06029 to the API
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:02:46Z',
 'fuel_type': 'petrol',
 'id': 'db44d376-ccb5-5dfc-97a7-3802a6813b36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS06029',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 139364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-15',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Style Viva',
 'transmission': 'manual',
 'trim': 'Style Viva',
 'year': 2012}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Saving data for FS06029: {'auction_closing_time': 1774713766.0, 'created_time': 1774330536.165143, 'last_price_update_time': 1774696388.589098}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS06029') HTTP/1.1" 204 0
2026-03-28 11:13:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791
2026-03-28 11:13:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791
2026-03-28 11:13:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec0771a0-fadd-589a-8c26-6732aeac7bcd with identifier: RW84791 to the API
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:24:09Z',
 'fuel_type': 'diesel',
 'id': 'ec0771a0-fadd-589a-8c26-6732aeac7bcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW84791',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 98258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-17',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI clean diesel',
 'transmission': 'automatic',
 'trim': 'clean diesel',
 'year': 2016}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Saving data for RW84791: {'auction_closing_time': 1774715049.0, 'created_time': 1773861770.607587, 'last_price_update_time': 1774696388.958294}
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW84791') HTTP/1.1" 204 0
2026-03-28 11:13:08 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-28 11:13:08 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-28 11:13:08 [auto1.de] INFO: Scrape type for UB65858: 2
2026-03-28 11:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858
2026-03-28 11:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with scrape type 2
2026-03-28 11:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with scrape type 2
2026-03-28 11:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051, identifier: UB65858
2026-03-28 11:13:09 [auto1.de] INFO: Found listing with ID: EJ47665
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47665%27 HTTP/1.1" 200 None
2026-03-28 11:13:09 [auto1.de] INFO: Scrape type for EJ47665: 2
2026-03-28 11:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8602143-0418-52e3-871e-5f5ebbfae78c with identifier: EJ47665
2026-03-28 11:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8602143-0418-52e3-871e-5f5ebbfae78c with scrape type 2
2026-03-28 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8602143-0418-52e3-871e-5f5ebbfae78c with scrape type 2
2026-03-28 11:13:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8602143-0418-52e3-871e-5f5ebbfae78c, identifier: EJ47665
2026-03-28 11:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858
2026-03-28 11:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858
2026-03-28 11:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 932b5149-bb5d-5fe5-8957-cb4cb7ab3051 with identifier: UB65858 to the API
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:13:49Z',
 'fuel_type': 'petrol',
 'id': '932b5149-bb5d-5fe5-8957-cb4cb7ab3051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB65858',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 168406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTI BlueMotion Tech',
 'year': 2013}
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-28 11:13:09 [auto1.de] INFO: Saving data for UB65858: {'auction_closing_time': 1774714429.0, 'created_time': 1773303320.417177, 'last_price_update_time': 1774696389.531005}
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB65858') HTTP/1.1" 204 0
2026-03-28 11:13:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8602143-0418-52e3-871e-5f5ebbfae78c with identifier: EJ47665
2026-03-28 11:13:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8602143-0418-52e3-871e-5f5ebbfae78c with identifier: EJ47665
2026-03-28 11:13:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8602143-0418-52e3-871e-5f5ebbfae78c with identifier: EJ47665 to the API
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-28T16:00:48Z',
 'fuel_type': 'diesel',
 'id': 'd8602143-0418-52e3-871e-5f5ebbfae78c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ47665',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 286365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-04',
 'seller_name': None,
 'title': 'BMW 7er 730d L xDrive',
 'transmission': 'automatic',
 'trim': 'L xDrive',
 'year': 2018}
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47665%27 HTTP/1.1" 200 None
2026-03-28 11:13:09 [auto1.de] INFO: Saving data for EJ47665: {'auction_closing_time': 1774713648.0, 'created_time': 1774608457.001777, 'last_price_update_time': 1774696389.85961}
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ47665') HTTP/1.1" 204 0
2026-03-28 11:13:09 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-28 11:13:09 [auto1.de] INFO: Scrape type for TH26087: 2
2026-03-28 11:13:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087
2026-03-28 11:13:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92172397-a815-5672-a7d9-fb09af2f7bbd with scrape type 2
2026-03-28 11:13:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92172397-a815-5672-a7d9-fb09af2f7bbd with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92172397-a815-5672-a7d9-fb09af2f7bbd, identifier: TH26087
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Scrape type for DM49539: 2
2026-03-28 11:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539
2026-03-28 11:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e482be7a-5a9d-5107-be5f-6d26aa03110a with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e482be7a-5a9d-5107-be5f-6d26aa03110a with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e482be7a-5a9d-5107-be5f-6d26aa03110a, identifier: DM49539
2026-03-28 11:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087
2026-03-28 11:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087
2026-03-28 11:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92172397-a815-5672-a7d9-fb09af2f7bbd with identifier: TH26087 to the API
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:23:52Z',
 'fuel_type': 'petrol',
 'id': '92172397-a815-5672-a7d9-fb09af2f7bbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH26087',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 138024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Saving data for TH26087: {'auction_closing_time': 1774715032.0, 'created_time': 1773689134.606667, 'last_price_update_time': 1774696390.463718}
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH26087') HTTP/1.1" 204 0
2026-03-28 11:13:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539
2026-03-28 11:13:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539
2026-03-28 11:13:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e482be7a-5a9d-5107-be5f-6d26aa03110a with identifier: DM49539 to the API
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:12:50Z',
 'fuel_type': 'petrol',
 'id': 'e482be7a-5a9d-5107-be5f-6d26aa03110a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM49539',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 174379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Honda Civic 1.8 i-VTEC Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2014}
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Saving data for DM49539: {'auction_closing_time': 1774714370.0, 'created_time': 1774291496.620035, 'last_price_update_time': 1774696390.790283}
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM49539') HTTP/1.1" 204 0
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Scrape type for BM76815: 2
2026-03-28 11:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815
2026-03-28 11:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e186861a-a067-5e46-8066-0a3c3b6c158d with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e186861a-a067-5e46-8066-0a3c3b6c158d with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e186861a-a067-5e46-8066-0a3c3b6c158d, identifier: BM76815
2026-03-28 11:13:10 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-28 11:13:10 [auto1.de] INFO: Scrape type for UH91436: 2
2026-03-28 11:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436
2026-03-28 11:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83d39a44-8562-54af-b1e6-acda3330eaed with scrape type 2
2026-03-28 11:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83d39a44-8562-54af-b1e6-acda3330eaed with scrape type 2
2026-03-28 11:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83d39a44-8562-54af-b1e6-acda3330eaed, identifier: UH91436
2026-03-28 11:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815
2026-03-28 11:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815
2026-03-28 11:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e186861a-a067-5e46-8066-0a3c3b6c158d with identifier: BM76815 to the API
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:39Z',
 'fuel_type': 'diesel',
 'id': 'e186861a-a067-5e46-8066-0a3c3b6c158d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM76815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 227357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-26',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-28 11:13:11 [auto1.de] INFO: Saving data for BM76815: {'auction_closing_time': 1774715979.0, 'created_time': 1773860126.575271, 'last_price_update_time': 1774696391.432568}
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM76815') HTTP/1.1" 204 0
2026-03-28 11:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436
2026-03-28 11:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436
2026-03-28 11:13:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83d39a44-8562-54af-b1e6-acda3330eaed with identifier: UH91436 to the API
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:18:20Z',
 'fuel_type': 'hybrid',
 'id': '83d39a44-8562-54af-b1e6-acda3330eaed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH91436',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 91304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-21',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-28 11:13:11 [auto1.de] INFO: Saving data for UH91436: {'auction_closing_time': 1774714700.0, 'created_time': 1773772567.508528, 'last_price_update_time': 1774696391.825626}
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH91436') HTTP/1.1" 204 0
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: ZN72039
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN72039%27 HTTP/1.1" 200 None
2026-03-28 11:13:11 [auto1.de] INFO: Scrape type for ZN72039: 2
2026-03-28 11:13:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ee9e216-363a-52e9-a4cf-dae96a837a26 with identifier: ZN72039
2026-03-28 11:13:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ee9e216-363a-52e9-a4cf-dae96a837a26 with scrape type 2
2026-03-28 11:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ee9e216-363a-52e9-a4cf-dae96a837a26 with scrape type 2
2026-03-28 11:13:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ee9e216-363a-52e9-a4cf-dae96a837a26, identifier: ZN72039
2026-03-28 11:13:11 [auto1.de] INFO: Found listing with ID: LB73186
2026-03-28 11:13:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ee9e216-363a-52e9-a4cf-dae96a837a26 with identifier: ZN72039
2026-03-28 11:13:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ee9e216-363a-52e9-a4cf-dae96a837a26 with identifier: ZN72039
2026-03-28 11:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ee9e216-363a-52e9-a4cf-dae96a837a26 with identifier: ZN72039 to the API
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 394,
 'expiration_date': '2026-03-28T16:33:32Z',
 'fuel_type': 'hybrid',
 'id': '3ee9e216-363a-52e9-a4cf-dae96a837a26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN72039',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 94022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-06',
 'seller_name': None,
 'title': 'BMW 5er 545e xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN72039%27 HTTP/1.1" 200 None
2026-03-28 11:13:12 [auto1.de] INFO: Saving data for ZN72039: {'auction_closing_time': 1774715612.0, 'created_time': 1773307898.885622, 'last_price_update_time': 1774696392.341611}
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN72039') HTTP/1.1" 204 0
2026-03-28 11:13:12 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-28 11:13:12 [auto1.de] INFO: Scrape type for WU91677: 2
2026-03-28 11:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677
2026-03-28 11:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 458562e3-27f6-52aa-9eaf-998992f036b9 with scrape type 2
2026-03-28 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 458562e3-27f6-52aa-9eaf-998992f036b9 with scrape type 2
2026-03-28 11:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 458562e3-27f6-52aa-9eaf-998992f036b9, identifier: WU91677
2026-03-28 11:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677
2026-03-28 11:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677
2026-03-28 11:13:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 458562e3-27f6-52aa-9eaf-998992f036b9 with identifier: WU91677 to the API
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:07Z',
 'fuel_type': 'diesel',
 'id': '458562e3-27f6-52aa-9eaf-998992f036b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU91677',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 191761,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.0 dCi LE 4x4',
 'transmission': 'manual',
 'trim': 'LE 4x4',
 'year': 2014}
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-28 11:13:12 [auto1.de] INFO: Saving data for WU91677: {'auction_closing_time': 1774714147.0, 'created_time': 1773307687.957752, 'last_price_update_time': 1774696392.805713}
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU91677') HTTP/1.1" 204 0
2026-03-28 11:13:12 [auto1.de] INFO: Channel: 24h | Page: 232 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:12 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-28 11:13:12 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-28 11:13:12 [auto1.de] INFO: Scrape type for WF94997: 2
2026-03-28 11:13:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997
2026-03-28 11:13:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73659620-789d-5430-ac35-bd3f82392bfb with scrape type 2
2026-03-28 11:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73659620-789d-5430-ac35-bd3f82392bfb with scrape type 2
2026-03-28 11:13:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73659620-789d-5430-ac35-bd3f82392bfb, identifier: WF94997
2026-03-28 11:13:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997
2026-03-28 11:13:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997
2026-03-28 11:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73659620-789d-5430-ac35-bd3f82392bfb with identifier: WF94997 to the API
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:22Z',
 'fuel_type': 'petrol',
 'id': '73659620-789d-5430-ac35-bd3f82392bfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF94997',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 221038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2018}
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-28 11:13:13 [auto1.de] INFO: Saving data for WF94997: {'auction_closing_time': 1774714402.0, 'created_time': 1773307720.280905, 'last_price_update_time': 1774696393.247724}
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF94997') HTTP/1.1" 204 0
2026-03-28 11:13:13 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-28 11:13:13 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-28 11:13:13 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-28 11:13:13 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-28 11:13:13 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-28 11:13:13 [auto1.de] INFO: Scrape type for VW42745: 2
2026-03-28 11:13:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745
2026-03-28 11:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9697cc-688a-521b-a151-50100d46ec6b with scrape type 2
2026-03-28 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd9697cc-688a-521b-a151-50100d46ec6b with scrape type 2
2026-03-28 11:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd9697cc-688a-521b-a151-50100d46ec6b, identifier: VW42745
2026-03-28 11:13:13 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-28 11:13:13 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-28 11:13:13 [auto1.de] INFO: Scrape type for ZY07029: 2
2026-03-28 11:13:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029
2026-03-28 11:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d077a248-a8f1-5071-81c9-68e9f53a0bb6 with scrape type 2
2026-03-28 11:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d077a248-a8f1-5071-81c9-68e9f53a0bb6 with scrape type 2
2026-03-28 11:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d077a248-a8f1-5071-81c9-68e9f53a0bb6, identifier: ZY07029
2026-03-28 11:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745
2026-03-28 11:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745
2026-03-28 11:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd9697cc-688a-521b-a151-50100d46ec6b with identifier: VW42745 to the API
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:56:16Z',
 'fuel_type': 'diesel',
 'id': 'fd9697cc-688a-521b-a151-50100d46ec6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW42745',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 256460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket plus',
 'year': 2014}
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-28 11:13:13 [auto1.de] INFO: Saving data for VW42745: {'auction_closing_time': 1774716976.0, 'created_time': 1773305991.729086, 'last_price_update_time': 1774696393.825886}
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW42745') HTTP/1.1" 204 0
2026-03-28 11:13:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029
2026-03-28 11:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029
2026-03-28 11:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d077a248-a8f1-5071-81c9-68e9f53a0bb6 with identifier: ZY07029 to the API
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-28T16:35:56Z',
 'fuel_type': 'petrol',
 'id': 'd077a248-a8f1-5071-81c9-68e9f53a0bb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY07029',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 94990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-28 11:13:14 [auto1.de] INFO: Saving data for ZY07029: {'auction_closing_time': 1774715756.0, 'created_time': 1773819347.510762, 'last_price_update_time': 1774696394.251395}
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY07029') HTTP/1.1" 204 0
2026-03-28 11:13:14 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-28 11:13:14 [auto1.de] INFO: Scrape type for CD81555: 2
2026-03-28 11:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555
2026-03-28 11:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 953a0633-1769-5717-8fec-b8892482a997 with scrape type 2
2026-03-28 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 953a0633-1769-5717-8fec-b8892482a997 with scrape type 2
2026-03-28 11:13:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 953a0633-1769-5717-8fec-b8892482a997, identifier: CD81555
2026-03-28 11:13:14 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-28 11:13:14 [auto1.de] INFO: Scrape type for BU23510: 2
2026-03-28 11:13:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510
2026-03-28 11:13:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with scrape type 2
2026-03-28 11:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with scrape type 2
2026-03-28 11:13:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13d5bf30-0db6-5a11-bfe6-d6afa666a633, identifier: BU23510
2026-03-28 11:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555
2026-03-28 11:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555
2026-03-28 11:13:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 953a0633-1769-5717-8fec-b8892482a997 with identifier: CD81555 to the API
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-28T16:07:39Z',
 'fuel_type': 'diesel',
 'id': '953a0633-1769-5717-8fec-b8892482a997',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD81555',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 94289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-02',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi EcoBlue ST-Line 4x4',
 'transmission': 'automatic',
 'trim': 'ST-Line 4x4',
 'year': 2019}
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-28 11:13:14 [auto1.de] INFO: Saving data for CD81555: {'auction_closing_time': 1774714059.0, 'created_time': 1774293613.284069, 'last_price_update_time': 1774696394.889513}
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD81555') HTTP/1.1" 204 0
2026-03-28 11:13:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510
2026-03-28 11:13:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510
2026-03-28 11:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13d5bf30-0db6-5a11-bfe6-d6afa666a633 with identifier: BU23510 to the API
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-28T16:56:19Z',
 'fuel_type': 'petrol',
 'id': '13d5bf30-0db6-5a11-bfe6-d6afa666a633',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU23510',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 117986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-15',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2014}
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-28 11:13:15 [auto1.de] INFO: Saving data for BU23510: {'auction_closing_time': 1774716979.0, 'created_time': 1773743756.13656, 'last_price_update_time': 1774696395.227198}
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU23510') HTTP/1.1" 204 0
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-28 11:13:15 [auto1.de] INFO: Scrape type for SW77788: 2
2026-03-28 11:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788
2026-03-28 11:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eab29c30-b714-5e56-9f83-942f66d0503f with scrape type 2
2026-03-28 11:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eab29c30-b714-5e56-9f83-942f66d0503f with scrape type 2
2026-03-28 11:13:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eab29c30-b714-5e56-9f83-942f66d0503f, identifier: SW77788
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: ME69590
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-28 11:13:15 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-28 11:13:15 [auto1.de] INFO: Scrape type for JP08522: 2
2026-03-28 11:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522
2026-03-28 11:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13a10737-a574-5160-975e-4171b70477a8 with scrape type 2
2026-03-28 11:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13a10737-a574-5160-975e-4171b70477a8 with scrape type 2
2026-03-28 11:13:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13a10737-a574-5160-975e-4171b70477a8, identifier: JP08522
2026-03-28 11:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788
2026-03-28 11:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788
2026-03-28 11:13:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eab29c30-b714-5e56-9f83-942f66d0503f with identifier: SW77788 to the API
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:29:58Z',
 'fuel_type': 'diesel',
 'id': 'eab29c30-b714-5e56-9f83-942f66d0503f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW77788',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 268536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-31',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-28 11:13:15 [auto1.de] INFO: Saving data for SW77788: {'auction_closing_time': 1774715398.0, 'created_time': 1774292264.939093, 'last_price_update_time': 1774696395.973844}
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW77788') HTTP/1.1" 204 0
2026-03-28 11:13:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522
2026-03-28 11:13:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522
2026-03-28 11:13:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13a10737-a574-5160-975e-4171b70477a8 with identifier: JP08522 to the API
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:31Z',
 'fuel_type': 'petrol',
 'id': '13a10737-a574-5160-975e-4171b70477a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP08522',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 54082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-01',
 'seller_name': None,
 'title': 'Seat Tarraco 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-28 11:13:16 [auto1.de] INFO: Saving data for JP08522: {'auction_closing_time': 1774714891.0, 'created_time': 1774608463.639286, 'last_price_update_time': 1774696396.609285}
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP08522') HTTP/1.1" 204 0
2026-03-28 11:13:16 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-28 11:13:16 [auto1.de] INFO: Scrape type for HR27692: 2
2026-03-28 11:13:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692
2026-03-28 11:13:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe34305e-32dd-5705-aee0-73c52ad7fd9d with scrape type 2
2026-03-28 11:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe34305e-32dd-5705-aee0-73c52ad7fd9d with scrape type 2
2026-03-28 11:13:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe34305e-32dd-5705-aee0-73c52ad7fd9d, identifier: HR27692
2026-03-28 11:13:16 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-28 11:13:16 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-28 11:13:16 [auto1.de] INFO: Scrape type for HD52891: 2
2026-03-28 11:13:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891
2026-03-28 11:13:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with scrape type 2
2026-03-28 11:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with scrape type 2
2026-03-28 11:13:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d, identifier: HD52891
2026-03-28 11:13:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692
2026-03-28 11:13:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692
2026-03-28 11:13:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe34305e-32dd-5705-aee0-73c52ad7fd9d with identifier: HR27692 to the API
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:33:45Z',
 'fuel_type': 'petrol',
 'id': 'fe34305e-32dd-5705-aee0-73c52ad7fd9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR27692',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 155016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-28 11:13:17 [auto1.de] INFO: Saving data for HR27692: {'auction_closing_time': 1774715625.0, 'created_time': 1773383253.046544, 'last_price_update_time': 1774696397.28743}
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR27692') HTTP/1.1" 204 0
2026-03-28 11:13:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891
2026-03-28 11:13:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891
2026-03-28 11:13:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c04c2bd-a3af-503f-937e-3b7c5fafe64d with identifier: HD52891 to the API
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 156,
 'expiration_date': '2026-03-28T16:20:27Z',
 'fuel_type': 'petrol',
 'id': '2c04c2bd-a3af-503f-937e-3b7c5fafe64d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD52891',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 126447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2020}
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-28 11:13:17 [auto1.de] INFO: Saving data for HD52891: {'auction_closing_time': 1774714827.0, 'created_time': 1772542408.492189, 'last_price_update_time': 1774696397.853295}
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD52891') HTTP/1.1" 204 0
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: SP58738
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: TZ19731
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-28 11:13:17 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-28 11:13:17 [auto1.de] INFO: Scrape type for JN93492: 2
2026-03-28 11:13:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492
2026-03-28 11:13:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87992e54-b8ab-516c-b637-17cf4457785d with scrape type 2
2026-03-28 11:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87992e54-b8ab-516c-b637-17cf4457785d with scrape type 2
2026-03-28 11:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87992e54-b8ab-516c-b637-17cf4457785d, identifier: JN93492
2026-03-28 11:13:18 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-28 11:13:18 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-28 11:13:18 [auto1.de] INFO: Scrape type for ZN44804: 2
2026-03-28 11:13:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804
2026-03-28 11:13:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b057cf17-7d75-5278-82a8-a956ea96ed8a with scrape type 2
2026-03-28 11:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b057cf17-7d75-5278-82a8-a956ea96ed8a with scrape type 2
2026-03-28 11:13:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b057cf17-7d75-5278-82a8-a956ea96ed8a, identifier: ZN44804
2026-03-28 11:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492
2026-03-28 11:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492
2026-03-28 11:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87992e54-b8ab-516c-b637-17cf4457785d with identifier: JN93492 to the API
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:59:07Z',
 'fuel_type': 'petrol',
 'id': '87992e54-b8ab-516c-b637-17cf4457785d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN93492',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 136744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Edition 7 2WD',
 'transmission': 'manual',
 'trim': 'Edition 7 2WD',
 'year': 2015}
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-28 11:13:18 [auto1.de] INFO: Saving data for JN93492: {'auction_closing_time': 1774717147.0, 'created_time': 1774263097.869643, 'last_price_update_time': 1774696398.681518}
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN93492') HTTP/1.1" 204 0
2026-03-28 11:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804
2026-03-28 11:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804
2026-03-28 11:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b057cf17-7d75-5278-82a8-a956ea96ed8a with identifier: ZN44804 to the API
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:56:40Z',
 'fuel_type': 'diesel',
 'id': 'b057cf17-7d75-5278-82a8-a956ea96ed8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN44804',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 235997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'BMW X5 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-28 11:13:18 [auto1.de] INFO: Saving data for ZN44804: {'auction_closing_time': 1774717000.0, 'created_time': 1773340684.657667, 'last_price_update_time': 1774696398.978998}
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN44804') HTTP/1.1" 204 0
2026-03-28 11:13:18 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-28 11:13:19 [auto1.de] INFO: Scrape type for KG12536: 2
2026-03-28 11:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536
2026-03-28 11:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c05c1b57-e540-5855-8256-e1d569276788 with scrape type 2
2026-03-28 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c05c1b57-e540-5855-8256-e1d569276788 with scrape type 2
2026-03-28 11:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c05c1b57-e540-5855-8256-e1d569276788, identifier: KG12536
2026-03-28 11:13:19 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-28 11:13:19 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-28 11:13:19 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-28 11:13:19 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-28 11:13:19 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-28 11:13:19 [auto1.de] INFO: Scrape type for SB93381: 2
2026-03-28 11:13:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381
2026-03-28 11:13:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9925289e-67ef-51a3-84d2-bb86a3f5093c with scrape type 2
2026-03-28 11:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9925289e-67ef-51a3-84d2-bb86a3f5093c with scrape type 2
2026-03-28 11:13:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9925289e-67ef-51a3-84d2-bb86a3f5093c, identifier: SB93381
2026-03-28 11:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536
2026-03-28 11:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536
2026-03-28 11:13:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c05c1b57-e540-5855-8256-e1d569276788 with identifier: KG12536 to the API
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:09:23Z',
 'fuel_type': 'diesel',
 'id': 'c05c1b57-e540-5855-8256-e1d569276788',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG12536',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 233115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-27',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Comfortline',
 'transmission': 'automatic',
 'trim': 'Maxi Comfortline',
 'year': 2013}
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-28 11:13:19 [auto1.de] INFO: Saving data for KG12536: {'auction_closing_time': 1774714163.0, 'created_time': 1773831739.05196, 'last_price_update_time': 1774696399.599517}
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG12536') HTTP/1.1" 204 0
2026-03-28 11:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381
2026-03-28 11:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381
2026-03-28 11:13:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9925289e-67ef-51a3-84d2-bb86a3f5093c with identifier: SB93381 to the API
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:23:19Z',
 'fuel_type': 'diesel',
 'id': '9925289e-67ef-51a3-84d2-bb86a3f5093c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB93381',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 488170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-18',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-28 11:13:19 [auto1.de] INFO: Saving data for SB93381: {'auction_closing_time': 1774714999.0, 'created_time': 1773659355.284287, 'last_price_update_time': 1774696399.99912}
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB93381') HTTP/1.1" 204 0
2026-03-28 11:13:20 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-28 11:13:20 [auto1.de] INFO: Scrape type for VE70317: 2
2026-03-28 11:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317
2026-03-28 11:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with scrape type 2
2026-03-28 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with scrape type 2
2026-03-28 11:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 002e40f6-1d77-52ee-9d5c-990cb80dcea0, identifier: VE70317
2026-03-28 11:13:20 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-28 11:13:20 [auto1.de] INFO: Scrape type for JV68869: 2
2026-03-28 11:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869
2026-03-28 11:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e2de161-0c17-555e-b043-9e5ef9d21310 with scrape type 2
2026-03-28 11:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e2de161-0c17-555e-b043-9e5ef9d21310 with scrape type 2
2026-03-28 11:13:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e2de161-0c17-555e-b043-9e5ef9d21310, identifier: JV68869
2026-03-28 11:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317
2026-03-28 11:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317
2026-03-28 11:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 002e40f6-1d77-52ee-9d5c-990cb80dcea0 with identifier: VE70317 to the API
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:28:09Z',
 'fuel_type': 'diesel',
 'id': '002e40f6-1d77-52ee-9d5c-990cb80dcea0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE70317',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 214769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-14',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-28 11:13:20 [auto1.de] INFO: Saving data for VE70317: {'auction_closing_time': 1774715289.0, 'created_time': 1774263237.745154, 'last_price_update_time': 1774696400.597757}
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE70317') HTTP/1.1" 204 0
2026-03-28 11:13:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869
2026-03-28 11:13:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869
2026-03-28 11:13:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e2de161-0c17-555e-b043-9e5ef9d21310 with identifier: JV68869 to the API
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 174,
 'expiration_date': '2026-03-28T16:05:57Z',
 'fuel_type': 'diesel',
 'id': '7e2de161-0c17-555e-b043-9e5ef9d21310',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV68869',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'XT4',
 'odometer': 31053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-16',
 'seller_name': None,
 'title': 'Cadillac XT4 350D Launch Edition 2WD',
 'transmission': 'automatic',
 'trim': 'Launch Edition 2WD',
 'year': 2021}
2026-03-28 11:13:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-28 11:13:21 [auto1.de] INFO: Saving data for JV68869: {'auction_closing_time': 1774713957.0, 'created_time': 1774293852.557589, 'last_price_update_time': 1774696401.01002}
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV68869') HTTP/1.1" 204 0
2026-03-28 11:13:21 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-28 11:13:21 [auto1.de] INFO: Scrape type for XZ35475: 2
2026-03-28 11:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475
2026-03-28 11:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03ad88f-08f3-552b-a128-229003eeefb7 with scrape type 2
2026-03-28 11:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03ad88f-08f3-552b-a128-229003eeefb7 with scrape type 2
2026-03-28 11:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03ad88f-08f3-552b-a128-229003eeefb7, identifier: XZ35475
2026-03-28 11:13:21 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-28 11:13:21 [auto1.de] INFO: Scrape type for FS76993: 2
2026-03-28 11:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993
2026-03-28 11:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23d532b8-0c6e-5906-a5cb-993b1fc60640 with scrape type 2
2026-03-28 11:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23d532b8-0c6e-5906-a5cb-993b1fc60640 with scrape type 2
2026-03-28 11:13:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23d532b8-0c6e-5906-a5cb-993b1fc60640, identifier: FS76993
2026-03-28 11:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475
2026-03-28 11:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475
2026-03-28 11:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03ad88f-08f3-552b-a128-229003eeefb7 with identifier: XZ35475 to the API
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-28T16:47:04Z',
 'fuel_type': 'diesel',
 'id': 'b03ad88f-08f3-552b-a128-229003eeefb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ35475',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 279155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-10',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2006}
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-28 11:13:21 [auto1.de] INFO: Saving data for XZ35475: {'auction_closing_time': 1774716424.0, 'created_time': 1773858921.766989, 'last_price_update_time': 1774696401.69887}
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ35475') HTTP/1.1" 204 0
2026-03-28 11:13:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993
2026-03-28 11:13:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993
2026-03-28 11:13:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23d532b8-0c6e-5906-a5cb-993b1fc60640 with identifier: FS76993 to the API
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:23:01Z',
 'fuel_type': 'petrol',
 'id': '23d532b8-0c6e-5906-a5cb-993b1fc60640',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS76993',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 193868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-19',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-28 11:13:22 [auto1.de] INFO: Saving data for FS76993: {'auction_closing_time': 1774714981.0, 'created_time': 1773775079.926346, 'last_price_update_time': 1774696402.073936}
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS76993') HTTP/1.1" 204 0
2026-03-28 11:13:22 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-28 11:13:22 [auto1.de] INFO: Scrape type for XZ46710: 2
2026-03-28 11:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710
2026-03-28 11:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with scrape type 2
2026-03-28 11:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with scrape type 2
2026-03-28 11:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053, identifier: XZ46710
2026-03-28 11:13:22 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-28 11:13:22 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-28 11:13:22 [auto1.de] INFO: Scrape type for KY06770: 2
2026-03-28 11:13:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770
2026-03-28 11:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35a331a9-dbf4-553e-9de9-e36818d279e2 with scrape type 2
2026-03-28 11:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35a331a9-dbf4-553e-9de9-e36818d279e2 with scrape type 2
2026-03-28 11:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35a331a9-dbf4-553e-9de9-e36818d279e2, identifier: KY06770
2026-03-28 11:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710
2026-03-28 11:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710
2026-03-28 11:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86ca72a1-cfb2-599e-8fe4-7e4ed134f053 with identifier: XZ46710 to the API
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:57:50Z',
 'fuel_type': 'petrol',
 'id': '86ca72a1-cfb2-599e-8fe4-7e4ed134f053',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ46710',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 142565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-07',
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.4 LS 2WD',
 'transmission': 'manual',
 'trim': 'LS 2WD',
 'year': 2010}
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-28 11:13:22 [auto1.de] INFO: Saving data for XZ46710: {'auction_closing_time': 1774717070.0, 'created_time': 1773304326.026895, 'last_price_update_time': 1774696402.761638}
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ46710') HTTP/1.1" 204 0
2026-03-28 11:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770
2026-03-28 11:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770
2026-03-28 11:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35a331a9-dbf4-553e-9de9-e36818d279e2 with identifier: KY06770 to the API
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:05:48Z',
 'fuel_type': 'diesel',
 'id': '35a331a9-dbf4-553e-9de9-e36818d279e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY06770',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 86624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Saving data for KY06770: {'auction_closing_time': 1774713948.0, 'created_time': 1774265070.092529, 'last_price_update_time': 1774696403.108016}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY06770') HTTP/1.1" 204 0
2026-03-28 11:13:23 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Scrape type for UH14154: 2
2026-03-28 11:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154
2026-03-28 11:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with scrape type 2
2026-03-28 11:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with scrape type 2
2026-03-28 11:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1, identifier: UH14154
2026-03-28 11:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154
2026-03-28 11:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154
2026-03-28 11:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28da6de1-f323-539f-9b1f-4f6a5cd5bfe1 with identifier: UH14154 to the API
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:17:24Z',
 'fuel_type': 'diesel',
 'id': '28da6de1-f323-539f-9b1f-4f6a5cd5bfe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH14154',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 330018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-31',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Saving data for UH14154: {'auction_closing_time': 1774714644.0, 'created_time': 1774291482.065451, 'last_price_update_time': 1774696403.505889}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH14154') HTTP/1.1" 204 0
2026-03-28 11:13:23 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-28 11:13:23 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-28 11:13:23 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Scrape type for MW91304: 2
2026-03-28 11:13:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304
2026-03-28 11:13:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131f0396-9ca0-54c4-9b3e-48194e51609a with scrape type 2
2026-03-28 11:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 131f0396-9ca0-54c4-9b3e-48194e51609a with scrape type 2
2026-03-28 11:13:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 131f0396-9ca0-54c4-9b3e-48194e51609a, identifier: MW91304
2026-03-28 11:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304
2026-03-28 11:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304
2026-03-28 11:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 131f0396-9ca0-54c4-9b3e-48194e51609a with identifier: MW91304 to the API
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:28:23Z',
 'fuel_type': 'petrol',
 'id': '131f0396-9ca0-54c4-9b3e-48194e51609a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW91304',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-28 11:13:23 [auto1.de] INFO: Saving data for MW91304: {'auction_closing_time': 1774715303.0, 'created_time': 1773303177.190709, 'last_price_update_time': 1774696403.945518}
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW91304') HTTP/1.1" 204 0
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-28 11:13:24 [auto1.de] INFO: Scrape type for TE25882: 2
2026-03-28 11:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882
2026-03-28 11:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e, identifier: TE25882
2026-03-28 11:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882
2026-03-28 11:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882
2026-03-28 11:13:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a58472f-dd8f-5a0c-88f0-5d45a91ba20e with identifier: TE25882 to the API
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:48:20Z',
 'fuel_type': 'petrol',
 'id': '9a58472f-dd8f-5a0c-88f0-5d45a91ba20e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE25882',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 173670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-28 11:13:24 [auto1.de] INFO: Saving data for TE25882: {'auction_closing_time': 1774716500.0, 'created_time': 1772546331.785917, 'last_price_update_time': 1774696404.608496}
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE25882') HTTP/1.1" 204 0
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-28 11:13:24 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-28 11:13:24 [auto1.de] INFO: Scrape type for JL71783: 2
2026-03-28 11:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783
2026-03-28 11:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with scrape type 2
2026-03-28 11:13:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f, identifier: JL71783
2026-03-28 11:13:24 [auto1.de] INFO: Channel: 24h | Page: 233 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783
2026-03-28 11:13:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783
2026-03-28 11:13:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f with identifier: JL71783 to the API
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:01:44Z',
 'fuel_type': 'petrol',
 'id': '11ac2bfa-1a5e-5d41-8ebf-f40e7c2c781f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL71783',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 141940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-15',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-28 11:13:25 [auto1.de] INFO: Saving data for JL71783: {'auction_closing_time': 1774713704.0, 'created_time': 1773400722.145193, 'last_price_update_time': 1774696405.012502}
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL71783') HTTP/1.1" 204 0
2026-03-28 11:13:25 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-28 11:13:25 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-28 11:13:25 [auto1.de] INFO: Scrape type for UG93766: 2
2026-03-28 11:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766
2026-03-28 11:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3222c970-a66b-53ff-a91c-54520670399b with scrape type 2
2026-03-28 11:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3222c970-a66b-53ff-a91c-54520670399b with scrape type 2
2026-03-28 11:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3222c970-a66b-53ff-a91c-54520670399b, identifier: UG93766
2026-03-28 11:13:25 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-28 11:13:25 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-28 11:13:25 [auto1.de] INFO: Scrape type for ZG28999: 2
2026-03-28 11:13:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999
2026-03-28 11:13:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adcebea2-b840-51ca-b32c-db2785840a8c with scrape type 2
2026-03-28 11:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item adcebea2-b840-51ca-b32c-db2785840a8c with scrape type 2
2026-03-28 11:13:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adcebea2-b840-51ca-b32c-db2785840a8c, identifier: ZG28999
2026-03-28 11:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766
2026-03-28 11:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766
2026-03-28 11:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3222c970-a66b-53ff-a91c-54520670399b with identifier: UG93766 to the API
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:47:45Z',
 'fuel_type': 'diesel',
 'id': '3222c970-a66b-53ff-a91c-54520670399b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG93766',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 274786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-03',
 'seller_name': None,
 'title': 'Hyundai i40 1.7 CRDi FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-28 11:13:25 [auto1.de] INFO: Saving data for UG93766: {'auction_closing_time': 1774716465.0, 'created_time': 1773307900.243244, 'last_price_update_time': 1774696405.641592}
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG93766') HTTP/1.1" 204 0
2026-03-28 11:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999
2026-03-28 11:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999
2026-03-28 11:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adcebea2-b840-51ca-b32c-db2785840a8c with identifier: ZG28999 to the API
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:05:37Z',
 'fuel_type': 'petrol',
 'id': 'adcebea2-b840-51ca-b32c-db2785840a8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG28999',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 33273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-14',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2019}
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-28 11:13:26 [auto1.de] INFO: Saving data for ZG28999: {'auction_closing_time': 1774713937.0, 'created_time': 1773688203.154083, 'last_price_update_time': 1774696406.165718}
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG28999') HTTP/1.1" 204 0
2026-03-28 11:13:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: MY83778
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-28 11:13:26 [auto1.de] INFO: Scrape type for PX08843: 2
2026-03-28 11:13:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843
2026-03-28 11:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with scrape type 2
2026-03-28 11:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with scrape type 2
2026-03-28 11:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d, identifier: PX08843
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-28 11:13:26 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-28 11:13:26 [auto1.de] INFO: Scrape type for RD48040: 2
2026-03-28 11:13:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040
2026-03-28 11:13:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c32564bb-c139-52af-bbbe-d4f17d68ca7b with scrape type 2
2026-03-28 11:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c32564bb-c139-52af-bbbe-d4f17d68ca7b with scrape type 2
2026-03-28 11:13:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c32564bb-c139-52af-bbbe-d4f17d68ca7b, identifier: RD48040
2026-03-28 11:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843
2026-03-28 11:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843
2026-03-28 11:13:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b2d2639-29b2-5fcf-866b-4b898fdbe17d with identifier: PX08843 to the API
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:47:45Z',
 'fuel_type': 'petrol',
 'id': '7b2d2639-29b2-5fcf-866b-4b898fdbe17d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX08843',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 20237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-23',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2023}
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-28 11:13:26 [auto1.de] INFO: Saving data for PX08843: {'auction_closing_time': 1774716465.0, 'created_time': 1773861459.200383, 'last_price_update_time': 1774696406.777411}
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX08843') HTTP/1.1" 204 0
2026-03-28 11:13:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040
2026-03-28 11:13:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040
2026-03-28 11:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c32564bb-c139-52af-bbbe-d4f17d68ca7b with identifier: RD48040 to the API
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:53:26Z',
 'fuel_type': 'petrol',
 'id': 'c32564bb-c139-52af-bbbe-d4f17d68ca7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD48040',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 305523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1992-10-31',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse 200 E',
 'transmission': 'manual',
 'trim': '',
 'year': 1992}
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-28 11:13:27 [auto1.de] INFO: Saving data for RD48040: {'auction_closing_time': 1774716806.0, 'created_time': 1774294103.875521, 'last_price_update_time': 1774696407.221161}
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD48040') HTTP/1.1" 204 0
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-28 11:13:27 [auto1.de] INFO: Scrape type for JH55559: 2
2026-03-28 11:13:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559
2026-03-28 11:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed1f10e2-161f-58d5-8371-53961ca29a46 with scrape type 2
2026-03-28 11:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed1f10e2-161f-58d5-8371-53961ca29a46 with scrape type 2
2026-03-28 11:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed1f10e2-161f-58d5-8371-53961ca29a46, identifier: JH55559
2026-03-28 11:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559
2026-03-28 11:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559
2026-03-28 11:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed1f10e2-161f-58d5-8371-53961ca29a46 with identifier: JH55559 to the API
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:10:22Z',
 'fuel_type': 'diesel',
 'id': 'ed1f10e2-161f-58d5-8371-53961ca29a46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH55559',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 154726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-28 11:13:27 [auto1.de] INFO: Saving data for JH55559: {'auction_closing_time': 1774714222.0, 'created_time': 1773341410.568232, 'last_price_update_time': 1774696407.807365}
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH55559') HTTP/1.1" 204 0
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-28 11:13:27 [auto1.de] INFO: Found listing with ID: RY91150
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91150%27 HTTP/1.1" 200 None
2026-03-28 11:13:27 [auto1.de] INFO: Scrape type for RY91150: 2
2026-03-28 11:13:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b78815eb-7af1-54a0-bd6d-8606612fd8bf with identifier: RY91150
2026-03-28 11:13:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b78815eb-7af1-54a0-bd6d-8606612fd8bf with scrape type 2
2026-03-28 11:13:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b78815eb-7af1-54a0-bd6d-8606612fd8bf with scrape type 2
2026-03-28 11:13:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b78815eb-7af1-54a0-bd6d-8606612fd8bf, identifier: RY91150
2026-03-28 11:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b78815eb-7af1-54a0-bd6d-8606612fd8bf with identifier: RY91150
2026-03-28 11:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b78815eb-7af1-54a0-bd6d-8606612fd8bf with identifier: RY91150
2026-03-28 11:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b78815eb-7af1-54a0-bd6d-8606612fd8bf with identifier: RY91150 to the API
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:17:49Z',
 'fuel_type': 'diesel',
 'id': 'b78815eb-7af1-54a0-bd6d-8606612fd8bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY91150',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 189022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-08',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2018}
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91150%27 HTTP/1.1" 200 None
2026-03-28 11:13:28 [auto1.de] INFO: Saving data for RY91150: {'auction_closing_time': 1774714669.0, 'created_time': 1774294198.161717, 'last_price_update_time': 1774696408.241771}
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY91150') HTTP/1.1" 204 0
2026-03-28 11:13:28 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-28 11:13:28 [auto1.de] INFO: Scrape type for DV93424: 2
2026-03-28 11:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424
2026-03-28 11:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1760e2c3-297e-5518-8b89-54d2c988df78 with scrape type 2
2026-03-28 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1760e2c3-297e-5518-8b89-54d2c988df78 with scrape type 2
2026-03-28 11:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1760e2c3-297e-5518-8b89-54d2c988df78, identifier: DV93424
2026-03-28 11:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424
2026-03-28 11:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424
2026-03-28 11:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1760e2c3-297e-5518-8b89-54d2c988df78 with identifier: DV93424 to the API
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:10:17Z',
 'fuel_type': 'petrol',
 'id': '1760e2c3-297e-5518-8b89-54d2c988df78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV93424',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 50708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-28 11:13:28 [auto1.de] INFO: Saving data for DV93424: {'auction_closing_time': 1774714217.0, 'created_time': 1773307152.263145, 'last_price_update_time': 1774696408.690244}
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV93424') HTTP/1.1" 204 0
2026-03-28 11:13:28 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-28 11:13:28 [auto1.de] INFO: Scrape type for UA99950: 2
2026-03-28 11:13:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950
2026-03-28 11:13:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d05bba50-ef86-5855-bfcb-1a0f73147370 with scrape type 2
2026-03-28 11:13:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d05bba50-ef86-5855-bfcb-1a0f73147370 with scrape type 2
2026-03-28 11:13:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d05bba50-ef86-5855-bfcb-1a0f73147370, identifier: UA99950
2026-03-28 11:13:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950
2026-03-28 11:13:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950
2026-03-28 11:13:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d05bba50-ef86-5855-bfcb-1a0f73147370 with identifier: UA99950 to the API
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:51:03Z',
 'fuel_type': 'diesel',
 'id': 'd05bba50-ef86-5855-bfcb-1a0f73147370',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA99950',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 265743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-21',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-28 11:13:29 [auto1.de] INFO: Saving data for UA99950: {'auction_closing_time': 1774716663.0, 'created_time': 1773429101.222429, 'last_price_update_time': 1774696409.131997}
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA99950') HTTP/1.1" 204 0
2026-03-28 11:13:29 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-28 11:13:29 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-28 11:13:29 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-28 11:13:29 [auto1.de] INFO: Scrape type for DJ76178: 2
2026-03-28 11:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178
2026-03-28 11:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with scrape type 2
2026-03-28 11:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with scrape type 2
2026-03-28 11:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4, identifier: DJ76178
2026-03-28 11:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178
2026-03-28 11:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178
2026-03-28 11:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12ec19a0-9dda-57ad-96dd-a4a9d1192aa4 with identifier: DJ76178 to the API
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:38:22Z',
 'fuel_type': 'petrol',
 'id': '12ec19a0-9dda-57ad-96dd-a4a9d1192aa4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ76178',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 207047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-30',
 'seller_name': None,
 'title': 'Seat Alhambra 2.8 V6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2005}
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-28 11:13:29 [auto1.de] INFO: Saving data for DJ76178: {'auction_closing_time': 1774715902.0, 'created_time': 1773380506.854756, 'last_price_update_time': 1774696409.588674}
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ76178') HTTP/1.1" 204 0
2026-03-28 11:13:29 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-28 11:13:29 [auto1.de] INFO: Scrape type for UT22988: 2
2026-03-28 11:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988
2026-03-28 11:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 966ecc0f-723b-5611-84f1-abfa73e497d3 with scrape type 2
2026-03-28 11:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 966ecc0f-723b-5611-84f1-abfa73e497d3 with scrape type 2
2026-03-28 11:13:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 966ecc0f-723b-5611-84f1-abfa73e497d3, identifier: UT22988
2026-03-28 11:13:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988
2026-03-28 11:13:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988
2026-03-28 11:13:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 966ecc0f-723b-5611-84f1-abfa73e497d3 with identifier: UT22988 to the API
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:52:37Z',
 'fuel_type': 'petrol',
 'id': '966ecc0f-723b-5611-84f1-abfa73e497d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT22988',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Jimny',
 'odometer': 90814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-23',
 'seller_name': None,
 'title': 'Suzuki Jimny 1.3 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-28 11:13:30 [auto1.de] INFO: Saving data for UT22988: {'auction_closing_time': 1774716757.0, 'created_time': 1773380973.573565, 'last_price_update_time': 1774696410.110821}
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT22988') HTTP/1.1" 204 0
2026-03-28 11:13:30 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-28 11:13:30 [auto1.de] INFO: Scrape type for SF51688: 2
2026-03-28 11:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688
2026-03-28 11:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cef081bb-b369-51fa-a235-9d3a33f23b83 with scrape type 2
2026-03-28 11:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cef081bb-b369-51fa-a235-9d3a33f23b83 with scrape type 2
2026-03-28 11:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cef081bb-b369-51fa-a235-9d3a33f23b83, identifier: SF51688
2026-03-28 11:13:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688
2026-03-28 11:13:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688
2026-03-28 11:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cef081bb-b369-51fa-a235-9d3a33f23b83 with identifier: SF51688 to the API
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:02:29Z',
 'fuel_type': 'petrol',
 'id': 'cef081bb-b369-51fa-a235-9d3a33f23b83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF51688',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 10925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-28',
 'seller_name': None,
 'title': 'Audi A1 Sportback 30 TFSI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2024}
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-28 11:13:30 [auto1.de] INFO: Saving data for SF51688: {'auction_closing_time': 1774713749.0, 'created_time': 1774608471.425328, 'last_price_update_time': 1774696410.569977}
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF51688') HTTP/1.1" 204 0
2026-03-28 11:13:30 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-28 11:13:30 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-28 11:13:30 [auto1.de] INFO: Scrape type for GN10929: 2
2026-03-28 11:13:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929
2026-03-28 11:13:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2131cd56-c29c-5882-8015-c739915f157d with scrape type 2
2026-03-28 11:13:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2131cd56-c29c-5882-8015-c739915f157d with scrape type 2
2026-03-28 11:13:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2131cd56-c29c-5882-8015-c739915f157d, identifier: GN10929
2026-03-28 11:13:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929
2026-03-28 11:13:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929
2026-03-28 11:13:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2131cd56-c29c-5882-8015-c739915f157d with identifier: GN10929 to the API
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:26:39Z',
 'fuel_type': 'diesel',
 'id': '2131cd56-c29c-5882-8015-c739915f157d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN10929',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 207316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-22',
 'seller_name': None,
 'title': 'Audi A6 Allroad 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-28 11:13:31 [auto1.de] INFO: Saving data for GN10929: {'auction_closing_time': 1774715199.0, 'created_time': 1773775069.022754, 'last_price_update_time': 1774696411.412791}
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN10929') HTTP/1.1" 204 0
2026-03-28 11:13:31 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-28 11:13:31 [auto1.de] INFO: Scrape type for VH64157: 2
2026-03-28 11:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157
2026-03-28 11:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with scrape type 2
2026-03-28 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with scrape type 2
2026-03-28 11:13:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d3d2342-effd-5ec6-bf30-e10f98816ea0, identifier: VH64157
2026-03-28 11:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157
2026-03-28 11:13:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157
2026-03-28 11:13:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d3d2342-effd-5ec6-bf30-e10f98816ea0 with identifier: VH64157 to the API
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:04:47Z',
 'fuel_type': 'petrol',
 'id': '6d3d2342-effd-5ec6-bf30-e10f98816ea0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH64157',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 178681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 250 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-28 11:13:31 [auto1.de] INFO: Saving data for VH64157: {'auction_closing_time': 1774713887.0, 'created_time': 1774292166.560878, 'last_price_update_time': 1774696411.892227}
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH64157') HTTP/1.1" 204 0
2026-03-28 11:13:31 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-28 11:13:31 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-28 11:13:31 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-28 11:13:31 [auto1.de] INFO: Scrape type for GA31653: 2
2026-03-28 11:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653
2026-03-28 11:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with scrape type 2
2026-03-28 11:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with scrape type 2
2026-03-28 11:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48, identifier: GA31653
2026-03-28 11:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653
2026-03-28 11:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653
2026-03-28 11:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08b001bf-ba1b-54de-ac6b-409fcb5c8f48 with identifier: GA31653 to the API
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:09:14Z',
 'fuel_type': 'petrol',
 'id': '08b001bf-ba1b-54de-ac6b-409fcb5c8f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA31653',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 86445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-04-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2003}
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-28 11:13:32 [auto1.de] INFO: Saving data for GA31653: {'auction_closing_time': 1774714154.0, 'created_time': 1774293769.249585, 'last_price_update_time': 1774696412.387061}
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA31653') HTTP/1.1" 204 0
2026-03-28 11:13:32 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-28 11:13:32 [auto1.de] INFO: Scrape type for NP49973: 2
2026-03-28 11:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973
2026-03-28 11:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5a3740-d5e5-5d3e-896b-f870b538d12a with scrape type 2
2026-03-28 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d5a3740-d5e5-5d3e-896b-f870b538d12a with scrape type 2
2026-03-28 11:13:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5a3740-d5e5-5d3e-896b-f870b538d12a, identifier: NP49973
2026-03-28 11:13:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973
2026-03-28 11:13:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973
2026-03-28 11:13:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5a3740-d5e5-5d3e-896b-f870b538d12a with identifier: NP49973 to the API
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:10:03Z',
 'fuel_type': 'diesel',
 'id': '5d5a3740-d5e5-5d3e-896b-f870b538d12a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP49973',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 207529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-21',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-28 11:13:32 [auto1.de] INFO: Saving data for NP49973: {'auction_closing_time': 1774714203.0, 'created_time': 1773302032.312806, 'last_price_update_time': 1774696412.906736}
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP49973') HTTP/1.1" 204 0
2026-03-28 11:13:32 [auto1.de] INFO: Channel: 24h | Page: 234 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:32 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-28 11:13:32 [auto1.de] INFO: Scrape type for GR11096: 2
2026-03-28 11:13:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096
2026-03-28 11:13:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with scrape type 2
2026-03-28 11:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with scrape type 2
2026-03-28 11:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6, identifier: GR11096
2026-03-28 11:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096
2026-03-28 11:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096
2026-03-28 11:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6 with identifier: GR11096 to the API
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:36:42Z',
 'fuel_type': 'petrol',
 'id': 'cc12d5c6-bc2e-5df9-adfc-89b909b8c7b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR11096',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 76482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-03',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-28 11:13:33 [auto1.de] INFO: Saving data for GR11096: {'auction_closing_time': 1774715802.0, 'created_time': 1773861611.305294, 'last_price_update_time': 1774696413.310739}
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR11096') HTTP/1.1" 204 0
2026-03-28 11:13:33 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-28 11:13:33 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-28 11:13:33 [auto1.de] INFO: Scrape type for JG77097: 2
2026-03-28 11:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097
2026-03-28 11:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772d95fe-2c21-52ae-be91-3df75dad471a with scrape type 2
2026-03-28 11:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 772d95fe-2c21-52ae-be91-3df75dad471a with scrape type 2
2026-03-28 11:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 772d95fe-2c21-52ae-be91-3df75dad471a, identifier: JG77097
2026-03-28 11:13:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:33 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-28 11:13:33 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-28 11:13:33 [auto1.de] INFO: Scrape type for CP54704: 2
2026-03-28 11:13:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704
2026-03-28 11:13:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with scrape type 2
2026-03-28 11:13:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with scrape type 2
2026-03-28 11:13:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c, identifier: CP54704
2026-03-28 11:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097
2026-03-28 11:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097
2026-03-28 11:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 772d95fe-2c21-52ae-be91-3df75dad471a with identifier: JG77097 to the API
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:09:51Z',
 'fuel_type': 'diesel',
 'id': '772d95fe-2c21-52ae-be91-3df75dad471a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG77097',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 240905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-29',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-28 11:13:33 [auto1.de] INFO: Saving data for JG77097: {'auction_closing_time': 1774714191.0, 'created_time': 1773307859.902645, 'last_price_update_time': 1774696413.882252}
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG77097') HTTP/1.1" 204 0
2026-03-28 11:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704
2026-03-28 11:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704
2026-03-28 11:13:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9cf7670-9fcc-535f-8fce-5ba5a944cd9c with identifier: CP54704 to the API
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:57:00Z',
 'fuel_type': 'diesel',
 'id': 'c9cf7670-9fcc-535f-8fce-5ba5a944cd9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP54704',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 227355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-08',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2018}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-28 11:13:34 [auto1.de] INFO: Saving data for CP54704: {'auction_closing_time': 1774717020.0, 'created_time': 1773302641.74825, 'last_price_update_time': 1774696414.335714}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP54704') HTTP/1.1" 204 0
2026-03-28 11:13:34 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-28 11:13:34 [auto1.de] INFO: Scrape type for FZ02201: 2
2026-03-28 11:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201
2026-03-28 11:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with scrape type 2
2026-03-28 11:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with scrape type 2
2026-03-28 11:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fa5303c-8ac4-5446-b0a9-88a39c883c47, identifier: FZ02201
2026-03-28 11:13:34 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-28 11:13:34 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-28 11:13:34 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-28 11:13:34 [auto1.de] INFO: Scrape type for JU59461: 2
2026-03-28 11:13:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461
2026-03-28 11:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3c5fe71-8c07-56e2-8f58-968243bff05b with scrape type 2
2026-03-28 11:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3c5fe71-8c07-56e2-8f58-968243bff05b with scrape type 2
2026-03-28 11:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3c5fe71-8c07-56e2-8f58-968243bff05b, identifier: JU59461
2026-03-28 11:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201
2026-03-28 11:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201
2026-03-28 11:13:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fa5303c-8ac4-5446-b0a9-88a39c883c47 with identifier: FZ02201 to the API
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:38:23Z',
 'fuel_type': 'diesel',
 'id': '0fa5303c-8ac4-5446-b0a9-88a39c883c47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ02201',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Country Tourer',
 'odometer': 154239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-01',
 'seller_name': None,
 'title': 'Opel Insignia Country Tourer 2.0 CDTI Basis ecoFlex',
 'transmission': 'manual',
 'trim': 'Basis ecoFlex',
 'year': 2015}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-28 11:13:34 [auto1.de] INFO: Saving data for FZ02201: {'auction_closing_time': 1774715903.0, 'created_time': 1773383109.789682, 'last_price_update_time': 1774696414.963533}
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ02201') HTTP/1.1" 204 0
2026-03-28 11:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461
2026-03-28 11:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461
2026-03-28 11:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3c5fe71-8c07-56e2-8f58-968243bff05b with identifier: JU59461 to the API
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:11:34Z',
 'fuel_type': 'petrol',
 'id': 'd3c5fe71-8c07-56e2-8f58-968243bff05b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU59461',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 68105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-28',
 'seller_name': None,
 'title': 'MINI Cooper Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2021}
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-28 11:13:35 [auto1.de] INFO: Saving data for JU59461: {'auction_closing_time': 1774714294.0, 'created_time': 1773306705.259039, 'last_price_update_time': 1774696415.269807}
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU59461') HTTP/1.1" 204 0
2026-03-28 11:13:35 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-28 11:13:35 [auto1.de] INFO: Scrape type for CJ75518: 2
2026-03-28 11:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518
2026-03-28 11:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with scrape type 2
2026-03-28 11:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with scrape type 2
2026-03-28 11:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff, identifier: CJ75518
2026-03-28 11:13:35 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-28 11:13:35 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-28 11:13:35 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-28 11:13:35 [auto1.de] INFO: Scrape type for AH29152: 2
2026-03-28 11:13:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152
2026-03-28 11:13:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49f56615-52d0-5321-b845-93fc1858acd7 with scrape type 2
2026-03-28 11:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49f56615-52d0-5321-b845-93fc1858acd7 with scrape type 2
2026-03-28 11:13:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49f56615-52d0-5321-b845-93fc1858acd7, identifier: AH29152
2026-03-28 11:13:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518
2026-03-28 11:13:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518
2026-03-28 11:13:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c5377ac-5e28-5ad9-b9c4-8eab17b465ff with identifier: CJ75518 to the API
2026-03-28 11:13:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-28T16:10:19Z',
 'fuel_type': 'diesel',
 'id': '1c5377ac-5e28-5ad9-b9c4-8eab17b465ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ75518',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 125691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2016}
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-28 11:13:36 [auto1.de] INFO: Saving data for CJ75518: {'auction_closing_time': 1774714219.0, 'created_time': 1774292273.678197, 'last_price_update_time': 1774696416.701022}
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ75518') HTTP/1.1" 204 0
2026-03-28 11:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152
2026-03-28 11:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152
2026-03-28 11:13:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49f56615-52d0-5321-b845-93fc1858acd7 with identifier: AH29152 to the API
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:28:19Z',
 'fuel_type': 'diesel',
 'id': '49f56615-52d0-5321-b845-93fc1858acd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH29152',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 152409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-27',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style 4Drive',
 'transmission': 'manual',
 'trim': 'Style 4Drive',
 'year': 2015}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Saving data for AH29152: {'auction_closing_time': 1774715299.0, 'created_time': 1773861732.855108, 'last_price_update_time': 1774696417.016154}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH29152') HTTP/1.1" 204 0
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Scrape type for UM10671: 2
2026-03-28 11:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671
2026-03-28 11:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af290f05-34d9-53ae-9ec7-07ccb5a76ca6, identifier: UM10671
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Scrape type for YY76457: 2
2026-03-28 11:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457
2026-03-28 11:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb6b7c9e-2962-5a4f-8022-7a697f5711f9, identifier: YY76457
2026-03-28 11:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671
2026-03-28 11:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671
2026-03-28 11:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af290f05-34d9-53ae-9ec7-07ccb5a76ca6 with identifier: UM10671 to the API
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:53:27Z',
 'fuel_type': 'petrol',
 'id': 'af290f05-34d9-53ae-9ec7-07ccb5a76ca6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM10671',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Orlando',
 'odometer': 219462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-30',
 'seller_name': None,
 'title': 'Chevrolet Orlando 1.4 TURBO LTZ',
 'transmission': 'manual',
 'trim': 'LTZ',
 'year': 2014}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Saving data for UM10671: {'auction_closing_time': 1774716807.0, 'created_time': 1773860982.54036, 'last_price_update_time': 1774696417.538067}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM10671') HTTP/1.1" 204 0
2026-03-28 11:13:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457
2026-03-28 11:13:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457
2026-03-28 11:13:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb6b7c9e-2962-5a4f-8022-7a697f5711f9 with identifier: YY76457 to the API
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:11:29Z',
 'fuel_type': 'petrol',
 'id': 'eb6b7c9e-2962-5a4f-8022-7a697f5711f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY76457',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 110081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Saving data for YY76457: {'auction_closing_time': 1774714289.0, 'created_time': 1773687981.50687, 'last_price_update_time': 1774696417.85858}
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY76457') HTTP/1.1" 204 0
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: US92808
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: AB79504
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-28 11:13:37 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-28 11:13:37 [auto1.de] INFO: Scrape type for BU48960: 2
2026-03-28 11:13:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960
2026-03-28 11:13:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a3dd8e-5578-5352-8644-f125f393ccfe with scrape type 2
2026-03-28 11:13:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92a3dd8e-5578-5352-8644-f125f393ccfe with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92a3dd8e-5578-5352-8644-f125f393ccfe, identifier: BU48960
2026-03-28 11:13:38 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-28 11:13:38 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-28 11:13:38 [auto1.de] INFO: Scrape type for FM08350: 2
2026-03-28 11:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350
2026-03-28 11:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8, identifier: FM08350
2026-03-28 11:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960
2026-03-28 11:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960
2026-03-28 11:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92a3dd8e-5578-5352-8644-f125f393ccfe with identifier: BU48960 to the API
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:24:03Z',
 'fuel_type': 'diesel',
 'id': '92a3dd8e-5578-5352-8644-f125f393ccfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU48960',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 52927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-09',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2018}
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-28 11:13:38 [auto1.de] INFO: Saving data for BU48960: {'auction_closing_time': 1774715043.0, 'created_time': 1774608507.813317, 'last_price_update_time': 1774696418.435489}
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU48960') HTTP/1.1" 204 0
2026-03-28 11:13:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350
2026-03-28 11:13:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350
2026-03-28 11:13:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8 with identifier: FM08350 to the API
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:55:10Z',
 'fuel_type': 'petrol',
 'id': 'b361f01a-0b9e-5ad9-a4d6-bc0c64586ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM08350',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 123104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-26',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-28 11:13:38 [auto1.de] INFO: Saving data for FM08350: {'auction_closing_time': 1774716910.0, 'created_time': 1773859217.239419, 'last_price_update_time': 1774696418.842403}
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM08350') HTTP/1.1" 204 0
2026-03-28 11:13:38 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-28 11:13:38 [auto1.de] INFO: Scrape type for NX83651: 2
2026-03-28 11:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651
2026-03-28 11:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9de8fa7f-5417-5574-a78b-1bdb61662d9f with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9de8fa7f-5417-5574-a78b-1bdb61662d9f with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9de8fa7f-5417-5574-a78b-1bdb61662d9f, identifier: NX83651
2026-03-28 11:13:38 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-28 11:13:38 [auto1.de] INFO: Scrape type for TB15164: 2
2026-03-28 11:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164
2026-03-28 11:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with scrape type 2
2026-03-28 11:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with scrape type 2
2026-03-28 11:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcbe0df5-f8c1-503e-b8d3-0c5217a51678, identifier: TB15164
2026-03-28 11:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651
2026-03-28 11:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651
2026-03-28 11:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9de8fa7f-5417-5574-a78b-1bdb61662d9f with identifier: NX83651 to the API
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:00:40Z',
 'fuel_type': 'petrol',
 'id': '9de8fa7f-5417-5574-a78b-1bdb61662d9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX83651',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 127594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-23',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-28 11:13:39 [auto1.de] INFO: Saving data for NX83651: {'auction_closing_time': 1774713640.0, 'created_time': 1773227981.692358, 'last_price_update_time': 1774696419.429607}
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX83651') HTTP/1.1" 204 0
2026-03-28 11:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164
2026-03-28 11:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164
2026-03-28 11:13:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcbe0df5-f8c1-503e-b8d3-0c5217a51678 with identifier: TB15164 to the API
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:30:36Z',
 'fuel_type': 'petrol',
 'id': 'dcbe0df5-f8c1-503e-b8d3-0c5217a51678',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB15164',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 177678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-01',
 'seller_name': None,
 'title': 'Opel Adam 1.0 Turbo Slam ecoFlex',
 'transmission': 'manual',
 'trim': 'Slam ecoFlex',
 'year': 2016}
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-28 11:13:39 [auto1.de] INFO: Saving data for TB15164: {'auction_closing_time': 1774715436.0, 'created_time': 1773401242.008756, 'last_price_update_time': 1774696419.773263}
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB15164') HTTP/1.1" 204 0
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-28 11:13:39 [auto1.de] INFO: Scrape type for DG35961: 2
2026-03-28 11:13:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961
2026-03-28 11:13:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 862f8487-4ffd-5030-9284-77a35a5d4a5d with scrape type 2
2026-03-28 11:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 862f8487-4ffd-5030-9284-77a35a5d4a5d with scrape type 2
2026-03-28 11:13:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 862f8487-4ffd-5030-9284-77a35a5d4a5d, identifier: DG35961
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-28 11:13:39 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-28 11:13:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961
2026-03-28 11:13:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961
2026-03-28 11:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 862f8487-4ffd-5030-9284-77a35a5d4a5d with identifier: DG35961 to the API
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:39:06Z',
 'fuel_type': 'petrol',
 'id': '862f8487-4ffd-5030-9284-77a35a5d4a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG35961',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 99624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-06-05',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2005}
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-28 11:13:40 [auto1.de] INFO: Saving data for DG35961: {'auction_closing_time': 1774715946.0, 'created_time': 1773689068.822942, 'last_price_update_time': 1774696420.248279}
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG35961') HTTP/1.1" 204 0
2026-03-28 11:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-28 11:13:40 [auto1.de] INFO: Scrape type for PE88968: 2
2026-03-28 11:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968
2026-03-28 11:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77a5f20-5f7c-5084-92de-b0e69f17457e with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e77a5f20-5f7c-5084-92de-b0e69f17457e with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e77a5f20-5f7c-5084-92de-b0e69f17457e, identifier: PE88968
2026-03-28 11:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968
2026-03-28 11:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968
2026-03-28 11:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e77a5f20-5f7c-5084-92de-b0e69f17457e with identifier: PE88968 to the API
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:28:42Z',
 'fuel_type': 'diesel',
 'id': 'e77a5f20-5f7c-5084-92de-b0e69f17457e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE88968',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 353995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-25',
 'seller_name': None,
 'title': 'BMW X5 3.0d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-28 11:13:40 [auto1.de] INFO: Saving data for PE88968: {'auction_closing_time': 1774715322.0, 'created_time': 1773687900.911489, 'last_price_update_time': 1774696420.685413}
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE88968') HTTP/1.1" 204 0
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: WJ93096
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: GG04913
2026-03-28 11:13:40 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-28 11:13:40 [auto1.de] INFO: Scrape type for BH52991: 2
2026-03-28 11:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991
2026-03-28 11:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c245e84d-4d51-5afd-a186-d7366278e0a2 with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c245e84d-4d51-5afd-a186-d7366278e0a2 with scrape type 2
2026-03-28 11:13:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c245e84d-4d51-5afd-a186-d7366278e0a2, identifier: BH52991
2026-03-28 11:13:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991
2026-03-28 11:13:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991
2026-03-28 11:13:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c245e84d-4d51-5afd-a186-d7366278e0a2 with identifier: BH52991 to the API
2026-03-28 11:13:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:25:06Z',
 'fuel_type': 'diesel',
 'id': 'c245e84d-4d51-5afd-a186-d7366278e0a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH52991',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 217795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-13',
 'seller_name': None,
 'title': 'Citroen C4 1.6 HDi Business Class',
 'transmission': 'manual',
 'trim': 'Business Class',
 'year': 2013}
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-28 11:13:41 [auto1.de] INFO: Saving data for BH52991: {'auction_closing_time': 1774715106.0, 'created_time': 1773401314.713024, 'last_price_update_time': 1774696421.170179}
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH52991') HTTP/1.1" 204 0
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-28 11:13:41 [auto1.de] INFO: Scrape type for DM95893: 2
2026-03-28 11:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893
2026-03-28 11:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 554b29d2-a347-5b52-86dd-7131753e682d with scrape type 2
2026-03-28 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 554b29d2-a347-5b52-86dd-7131753e682d with scrape type 2
2026-03-28 11:13:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 554b29d2-a347-5b52-86dd-7131753e682d, identifier: DM95893
2026-03-28 11:13:41 [auto1.de] INFO: Channel: 24h | Page: 235 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893
2026-03-28 11:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893
2026-03-28 11:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 554b29d2-a347-5b52-86dd-7131753e682d with identifier: DM95893 to the API
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:33Z',
 'fuel_type': 'diesel',
 'id': '554b29d2-a347-5b52-86dd-7131753e682d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM95893',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 186747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-18',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-28 11:13:41 [auto1.de] INFO: Saving data for DM95893: {'auction_closing_time': 1774716453.0, 'created_time': 1773858966.321153, 'last_price_update_time': 1774696421.760764}
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM95893') HTTP/1.1" 204 0
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-28 11:13:41 [auto1.de] INFO: Scrape type for XD89320: 2
2026-03-28 11:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320
2026-03-28 11:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f67830-93b5-5be8-a012-51868dbdf652 with scrape type 2
2026-03-28 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f67830-93b5-5be8-a012-51868dbdf652 with scrape type 2
2026-03-28 11:13:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2f67830-93b5-5be8-a012-51868dbdf652, identifier: XD89320
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-28 11:13:41 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-28 11:13:41 [auto1.de] INFO: Scrape type for AR19685: 2
2026-03-28 11:13:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685
2026-03-28 11:13:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with scrape type 2
2026-03-28 11:13:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with scrape type 2
2026-03-28 11:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bac0db4c-2fb6-50ca-9e6a-94a67850eed9, identifier: AR19685
2026-03-28 11:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320
2026-03-28 11:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320
2026-03-28 11:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2f67830-93b5-5be8-a012-51868dbdf652 with identifier: XD89320 to the API
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:35:54Z',
 'fuel_type': 'petrol',
 'id': 'd2f67830-93b5-5be8-a012-51868dbdf652',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD89320',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 117789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-11',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2014}
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-28 11:13:42 [auto1.de] INFO: Saving data for XD89320: {'auction_closing_time': 1774715754.0, 'created_time': 1773401439.753579, 'last_price_update_time': 1774696422.328282}
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD89320') HTTP/1.1" 204 0
2026-03-28 11:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685
2026-03-28 11:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685
2026-03-28 11:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bac0db4c-2fb6-50ca-9e6a-94a67850eed9 with identifier: AR19685 to the API
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:56:42Z',
 'fuel_type': 'hybrid',
 'id': 'bac0db4c-2fb6-50ca-9e6a-94a67850eed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR19685',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 84667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-28 11:13:42 [auto1.de] INFO: Saving data for AR19685: {'auction_closing_time': 1774717002.0, 'created_time': 1773301624.038718, 'last_price_update_time': 1774696422.6333}
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR19685') HTTP/1.1" 204 0
2026-03-28 11:13:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-28 11:13:42 [auto1.de] INFO: Scrape type for XR69964: 2
2026-03-28 11:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964
2026-03-28 11:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with scrape type 2
2026-03-28 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with scrape type 2
2026-03-28 11:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34ea99b0-957c-5d11-ac60-e10e72cfdb88, identifier: XR69964
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: HK54486
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-28 11:13:42 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-28 11:13:42 [auto1.de] INFO: Scrape type for LR85001: 2
2026-03-28 11:13:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001
2026-03-28 11:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8855642-69c3-5419-94e0-4fedac5943c0 with scrape type 2
2026-03-28 11:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8855642-69c3-5419-94e0-4fedac5943c0 with scrape type 2
2026-03-28 11:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8855642-69c3-5419-94e0-4fedac5943c0, identifier: LR85001
2026-03-28 11:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964
2026-03-28 11:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964
2026-03-28 11:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34ea99b0-957c-5d11-ac60-e10e72cfdb88 with identifier: XR69964 to the API
2026-03-28 11:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:57:47Z',
 'fuel_type': 'petrol',
 'id': '34ea99b0-957c-5d11-ac60-e10e72cfdb88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR69964',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 159236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-04',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-28 11:13:43 [auto1.de] INFO: Saving data for XR69964: {'auction_closing_time': 1774717067.0, 'created_time': 1773732952.323723, 'last_price_update_time': 1774696423.199141}
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR69964') HTTP/1.1" 204 0
2026-03-28 11:13:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001
2026-03-28 11:13:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001
2026-03-28 11:13:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8855642-69c3-5419-94e0-4fedac5943c0 with identifier: LR85001 to the API
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:33:04Z',
 'fuel_type': 'diesel',
 'id': 'd8855642-69c3-5419-94e0-4fedac5943c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR85001',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 296009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-09',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 114 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2017}
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-28 11:13:43 [auto1.de] INFO: Saving data for LR85001: {'auction_closing_time': 1774715584.0, 'created_time': 1773401169.283806, 'last_price_update_time': 1774696423.626234}
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR85001') HTTP/1.1" 204 0
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-28 11:13:43 [auto1.de] INFO: Scrape type for CA38480: 2
2026-03-28 11:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480
2026-03-28 11:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with scrape type 2
2026-03-28 11:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with scrape type 2
2026-03-28 11:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac, identifier: CA38480
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-28 11:13:43 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-28 11:13:43 [auto1.de] INFO: Scrape type for NA39997: 2
2026-03-28 11:13:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997
2026-03-28 11:13:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with scrape type 2
2026-03-28 11:13:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with scrape type 2
2026-03-28 11:13:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3, identifier: NA39997
2026-03-28 11:13:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480
2026-03-28 11:13:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480
2026-03-28 11:13:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac with identifier: CA38480 to the API
2026-03-28 11:13:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:40:25Z',
 'fuel_type': 'petrol',
 'id': '1e4f2eeb-1b96-5d2b-973e-ef4f8ad361ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA38480',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 124018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-05',
 'seller_name': None,
 'title': 'BMW Z4 sDrive 30i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Saving data for CA38480: {'auction_closing_time': 1774716025.0, 'created_time': 1773686206.157547, 'last_price_update_time': 1774696424.19524}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA38480') HTTP/1.1" 204 0
2026-03-28 11:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997
2026-03-28 11:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997
2026-03-28 11:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 953fa758-7e5a-5ae5-ab72-fa71fec34dd3 with identifier: NA39997 to the API
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:04:18Z',
 'fuel_type': 'petrol',
 'id': '953fa758-7e5a-5ae5-ab72-fa71fec34dd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA39997',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 116813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Saving data for NA39997: {'auction_closing_time': 1774713858.0, 'created_time': 1773303371.600227, 'last_price_update_time': 1774696424.491566}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA39997') HTTP/1.1" 204 0
2026-03-28 11:13:44 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Scrape type for PK38056: 2
2026-03-28 11:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056
2026-03-28 11:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with scrape type 2
2026-03-28 11:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with scrape type 2
2026-03-28 11:13:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61, identifier: PK38056
2026-03-28 11:13:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056
2026-03-28 11:13:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056
2026-03-28 11:13:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02ce3750-4fc2-521f-ab84-c34c1a9a7a61 with identifier: PK38056 to the API
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:48:31Z',
 'fuel_type': 'petrol',
 'id': '02ce3750-4fc2-521f-ab84-c34c1a9a7a61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK38056',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 231862,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-28',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Saving data for PK38056: {'auction_closing_time': 1774716511.0, 'created_time': 1773861139.727464, 'last_price_update_time': 1774696424.904441}
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PK38056') HTTP/1.1" 204 0
2026-03-28 11:13:44 [auto1.de] INFO: Found listing with ID: KK51592
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK51592%27 HTTP/1.1" 200 None
2026-03-28 11:13:44 [auto1.de] INFO: Scrape type for KK51592: 2
2026-03-28 11:13:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d00ef788-d77a-50fd-ab82-2445915f1f3d with identifier: KK51592
2026-03-28 11:13:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00ef788-d77a-50fd-ab82-2445915f1f3d with scrape type 2
2026-03-28 11:13:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d00ef788-d77a-50fd-ab82-2445915f1f3d with scrape type 2
2026-03-28 11:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d00ef788-d77a-50fd-ab82-2445915f1f3d, identifier: KK51592
2026-03-28 11:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d00ef788-d77a-50fd-ab82-2445915f1f3d with identifier: KK51592
2026-03-28 11:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d00ef788-d77a-50fd-ab82-2445915f1f3d with identifier: KK51592
2026-03-28 11:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d00ef788-d77a-50fd-ab82-2445915f1f3d with identifier: KK51592 to the API
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:46:29Z',
 'fuel_type': 'diesel',
 'id': 'd00ef788-d77a-50fd-ab82-2445915f1f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK51592',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi Energy L3H1 4,5t',
 'transmission': 'manual',
 'trim': 'L3H1 4,5t',
 'year': 2019}
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK51592%27 HTTP/1.1" 200 None
2026-03-28 11:13:45 [auto1.de] INFO: Saving data for KK51592: {'auction_closing_time': 1774716389.0, 'created_time': 1774608519.157895, 'last_price_update_time': 1774696425.321436}
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK51592') HTTP/1.1" 204 0
2026-03-28 11:13:45 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-28 11:13:45 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-28 11:13:45 [auto1.de] INFO: Scrape type for RC78323: 2
2026-03-28 11:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323
2026-03-28 11:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69289757-5979-5a6e-9285-c307ec39bc45 with scrape type 2
2026-03-28 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69289757-5979-5a6e-9285-c307ec39bc45 with scrape type 2
2026-03-28 11:13:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69289757-5979-5a6e-9285-c307ec39bc45, identifier: RC78323
2026-03-28 11:13:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323
2026-03-28 11:13:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323
2026-03-28 11:13:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69289757-5979-5a6e-9285-c307ec39bc45 with identifier: RC78323 to the API
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:10:58Z',
 'fuel_type': 'diesel',
 'id': '69289757-5979-5a6e-9285-c307ec39bc45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC78323',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 310154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-31',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-28 11:13:45 [auto1.de] INFO: Saving data for RC78323: {'auction_closing_time': 1774714258.0, 'created_time': 1773307252.562048, 'last_price_update_time': 1774696425.876736}
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC78323') HTTP/1.1" 204 0
2026-03-28 11:13:45 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-28 11:13:45 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-28 11:13:45 [auto1.de] INFO: Scrape type for VB96558: 2
2026-03-28 11:13:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558
2026-03-28 11:13:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 449f08bb-ac24-543d-8dbe-c0b409c9a547 with scrape type 2
2026-03-28 11:13:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 449f08bb-ac24-543d-8dbe-c0b409c9a547 with scrape type 2
2026-03-28 11:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 449f08bb-ac24-543d-8dbe-c0b409c9a547, identifier: VB96558
2026-03-28 11:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558
2026-03-28 11:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558
2026-03-28 11:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 449f08bb-ac24-543d-8dbe-c0b409c9a547 with identifier: VB96558 to the API
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:40:43Z',
 'fuel_type': 'diesel',
 'id': '449f08bb-ac24-543d-8dbe-c0b409c9a547',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB96558',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 153124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-14',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-28 11:13:46 [auto1.de] INFO: Saving data for VB96558: {'auction_closing_time': 1774716043.0, 'created_time': 1773307711.84879, 'last_price_update_time': 1774696426.490185}
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB96558') HTTP/1.1" 204 0
2026-03-28 11:13:46 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-28 11:13:46 [auto1.de] INFO: Scrape type for XA05617: 2
2026-03-28 11:13:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617
2026-03-28 11:13:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc3c4b08-3b82-5a58-b5e5-282acadf2628 with scrape type 2
2026-03-28 11:13:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc3c4b08-3b82-5a58-b5e5-282acadf2628 with scrape type 2
2026-03-28 11:13:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc3c4b08-3b82-5a58-b5e5-282acadf2628, identifier: XA05617
2026-03-28 11:13:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617
2026-03-28 11:13:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617
2026-03-28 11:13:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc3c4b08-3b82-5a58-b5e5-282acadf2628 with identifier: XA05617 to the API
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:14:11Z',
 'fuel_type': 'petrol',
 'id': 'bc3c4b08-3b82-5a58-b5e5-282acadf2628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA05617',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 158300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-31',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-28 11:13:47 [auto1.de] INFO: Saving data for XA05617: {'auction_closing_time': 1774714451.0, 'created_time': 1773383087.839684, 'last_price_update_time': 1774696427.038904}
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA05617') HTTP/1.1" 204 0
2026-03-28 11:13:47 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-28 11:13:47 [auto1.de] INFO: Scrape type for XC54847: 2
2026-03-28 11:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847
2026-03-28 11:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with scrape type 2
2026-03-28 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with scrape type 2
2026-03-28 11:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3, identifier: XC54847
2026-03-28 11:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847
2026-03-28 11:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847
2026-03-28 11:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94cff63e-1ade-50c7-a6f7-6d82f95a28f3 with identifier: XC54847 to the API
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:19:46Z',
 'fuel_type': 'petrol',
 'id': '94cff63e-1ade-50c7-a6f7-6d82f95a28f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC54847',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 163517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-21',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-28 11:13:47 [auto1.de] INFO: Saving data for XC54847: {'auction_closing_time': 1774714786.0, 'created_time': 1773305245.493745, 'last_price_update_time': 1774696427.463011}
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC54847') HTTP/1.1" 204 0
2026-03-28 11:13:47 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-28 11:13:47 [auto1.de] INFO: Scrape type for DF63833: 2
2026-03-28 11:13:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833
2026-03-28 11:13:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed48b641-bcbe-5e87-81c0-2a01c90703b8 with scrape type 2
2026-03-28 11:13:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed48b641-bcbe-5e87-81c0-2a01c90703b8 with scrape type 2
2026-03-28 11:13:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed48b641-bcbe-5e87-81c0-2a01c90703b8, identifier: DF63833
2026-03-28 11:13:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833
2026-03-28 11:13:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833
2026-03-28 11:13:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed48b641-bcbe-5e87-81c0-2a01c90703b8 with identifier: DF63833 to the API
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:48:43Z',
 'fuel_type': 'diesel',
 'id': 'ed48b641-bcbe-5e87-81c0-2a01c90703b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF63833',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 111776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2020}
2026-03-28 11:13:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Saving data for DF63833: {'auction_closing_time': 1774716523.0, 'created_time': 1773383086.297877, 'last_price_update_time': 1774696428.001311}
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF63833') HTTP/1.1" 204 0
2026-03-28 11:13:48 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Scrape type for YJ19270: 2
2026-03-28 11:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270
2026-03-28 11:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128, identifier: YJ19270
2026-03-28 11:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270
2026-03-28 11:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270
2026-03-28 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b2259c8-ff4b-5bb2-982d-b1d787e7c128 with identifier: YJ19270 to the API
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:41:00Z',
 'fuel_type': 'petrol',
 'id': '6b2259c8-ff4b-5bb2-982d-b1d787e7c128',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ19270',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 69432,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-04',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Saving data for YJ19270: {'auction_closing_time': 1774716060.0, 'created_time': 1773861661.218184, 'last_price_update_time': 1774696428.432119}
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ19270') HTTP/1.1" 204 0
2026-03-28 11:13:48 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Scrape type for MS86460: 2
2026-03-28 11:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460
2026-03-28 11:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d, identifier: MS86460
2026-03-28 11:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460
2026-03-28 11:13:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460
2026-03-28 11:13:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d with identifier: MS86460 to the API
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:05:04Z',
 'fuel_type': 'diesel',
 'id': 'df0ac5ba-05ef-5ff0-a7c4-bbfeec3b656d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS86460',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 157618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-29',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Saving data for MS86460: {'auction_closing_time': 1774713904.0, 'created_time': 1773402213.553474, 'last_price_update_time': 1774696428.86065}
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS86460') HTTP/1.1" 204 0
2026-03-28 11:13:48 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-28 11:13:48 [auto1.de] INFO: Scrape type for ZU48886: 2
2026-03-28 11:13:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886
2026-03-28 11:13:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4133d45-57bd-557c-bb08-5ae85945d7ae with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4133d45-57bd-557c-bb08-5ae85945d7ae with scrape type 2
2026-03-28 11:13:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4133d45-57bd-557c-bb08-5ae85945d7ae, identifier: ZU48886
2026-03-28 11:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886
2026-03-28 11:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886
2026-03-28 11:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4133d45-57bd-557c-bb08-5ae85945d7ae with identifier: ZU48886 to the API
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:44:09Z',
 'fuel_type': 'petrol',
 'id': 'e4133d45-57bd-557c-bb08-5ae85945d7ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU48886',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 182132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-12',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-28 11:13:49 [auto1.de] INFO: Saving data for ZU48886: {'auction_closing_time': 1774716249.0, 'created_time': 1773688878.788102, 'last_price_update_time': 1774696429.324088}
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU48886') HTTP/1.1" 204 0
2026-03-28 11:13:49 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-28 11:13:49 [auto1.de] INFO: Scrape type for NC07165: 2
2026-03-28 11:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165
2026-03-28 11:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e20c78-22ae-553e-bea3-0fb0b9d05184 with scrape type 2
2026-03-28 11:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e20c78-22ae-553e-bea3-0fb0b9d05184 with scrape type 2
2026-03-28 11:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23e20c78-22ae-553e-bea3-0fb0b9d05184, identifier: NC07165
2026-03-28 11:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165
2026-03-28 11:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165
2026-03-28 11:13:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23e20c78-22ae-553e-bea3-0fb0b9d05184 with identifier: NC07165 to the API
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:14:34Z',
 'fuel_type': 'diesel',
 'id': '23e20c78-22ae-553e-bea3-0fb0b9d05184',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC07165',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 152443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2013}
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-28 11:13:49 [auto1.de] INFO: Saving data for NC07165: {'auction_closing_time': 1774714474.0, 'created_time': 1773772525.232938, 'last_price_update_time': 1774696429.756616}
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC07165') HTTP/1.1" 204 0
2026-03-28 11:13:49 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-28 11:13:49 [auto1.de] INFO: Scrape type for NU47228: 2
2026-03-28 11:13:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228
2026-03-28 11:13:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466e3ba1-442e-5d10-b729-3c813070917a with scrape type 2
2026-03-28 11:13:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466e3ba1-442e-5d10-b729-3c813070917a with scrape type 2
2026-03-28 11:13:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 466e3ba1-442e-5d10-b729-3c813070917a, identifier: NU47228
2026-03-28 11:13:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228
2026-03-28 11:13:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228
2026-03-28 11:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 466e3ba1-442e-5d10-b729-3c813070917a with identifier: NU47228 to the API
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:00:46Z',
 'fuel_type': 'petrol',
 'id': '466e3ba1-442e-5d10-b729-3c813070917a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU47228',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 118552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-14',
 'seller_name': None,
 'title': "Renault Megane 1.6 Je t'aime",
 'transmission': 'manual',
 'trim': "Je t'aime",
 'year': 2011}
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-28 11:13:50 [auto1.de] INFO: Saving data for NU47228: {'auction_closing_time': 1774713646.0, 'created_time': 1773401167.45213, 'last_price_update_time': 1774696430.205624}
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU47228') HTTP/1.1" 204 0
2026-03-28 11:13:50 [auto1.de] INFO: Channel: 24h | Page: 236 | totalHits: 9712 | hits on page: 40
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: YW30878
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30878%27 HTTP/1.1" 200 None
2026-03-28 11:13:50 [auto1.de] INFO: Scrape type for YW30878: 2
2026-03-28 11:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abcc4438-1203-530a-9154-115fa3c28a5d with identifier: YW30878
2026-03-28 11:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abcc4438-1203-530a-9154-115fa3c28a5d with scrape type 2
2026-03-28 11:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abcc4438-1203-530a-9154-115fa3c28a5d with scrape type 2
2026-03-28 11:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: abcc4438-1203-530a-9154-115fa3c28a5d, identifier: YW30878
2026-03-28 11:13:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: abcc4438-1203-530a-9154-115fa3c28a5d with identifier: YW30878
2026-03-28 11:13:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: abcc4438-1203-530a-9154-115fa3c28a5d with identifier: YW30878
2026-03-28 11:13:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: abcc4438-1203-530a-9154-115fa3c28a5d with identifier: YW30878 to the API
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:51:42Z',
 'fuel_type': 'diesel',
 'id': 'abcc4438-1203-530a-9154-115fa3c28a5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW30878',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 317085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2015}
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30878%27 HTTP/1.1" 200 None
2026-03-28 11:13:50 [auto1.de] INFO: Saving data for YW30878: {'auction_closing_time': 1774716702.0, 'created_time': 1773858941.75772, 'last_price_update_time': 1774696430.65797}
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW30878') HTTP/1.1" 204 0
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-28 11:13:50 [auto1.de] INFO: Scrape type for TE97467: 2
2026-03-28 11:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467
2026-03-28 11:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with scrape type 2
2026-03-28 11:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with scrape type 2
2026-03-28 11:13:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08753a89-d7c3-5b67-9b86-47ea2c2b1030, identifier: TE97467
2026-03-28 11:13:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-28 11:13:50 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-28 11:13:50 [auto1.de] INFO: Scrape type for KV22200: 2
2026-03-28 11:13:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200
2026-03-28 11:13:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with scrape type 2
2026-03-28 11:13:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d, identifier: KV22200
2026-03-28 11:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467
2026-03-28 11:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467
2026-03-28 11:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08753a89-d7c3-5b67-9b86-47ea2c2b1030 with identifier: TE97467 to the API
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:08:33Z',
 'fuel_type': 'hybrid',
 'id': '08753a89-d7c3-5b67-9b86-47ea2c2b1030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE97467',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 22601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 PHEV 4WD',
 'transmission': 'automatic',
 'trim': '4WD',
 'year': 2020}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Saving data for TE97467: {'auction_closing_time': 1774714113.0, 'created_time': 1773860939.920139, 'last_price_update_time': 1774696431.302863}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE97467') HTTP/1.1" 204 0
2026-03-28 11:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200
2026-03-28 11:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200
2026-03-28 11:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc39fa41-ec43-5868-8f4f-2ec14a28bc7d with identifier: KV22200 to the API
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:31:52Z',
 'fuel_type': 'petrol',
 'id': 'dc39fa41-ec43-5868-8f4f-2ec14a28bc7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV22200',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 101003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Rip Curl',
 'transmission': 'manual',
 'trim': 'Rip Curl',
 'year': 2011}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Saving data for KV22200: {'auction_closing_time': 1774715512.0, 'created_time': 1774608513.908405, 'last_price_update_time': 1774696431.614799}
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV22200') HTTP/1.1" 204 0
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: CE61200
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE61200%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Scrape type for CE61200: 2
2026-03-28 11:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with identifier: CE61200
2026-03-28 11:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3, identifier: CE61200
2026-03-28 11:13:51 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-28 11:13:51 [auto1.de] INFO: Scrape type for MS46414: 2
2026-03-28 11:13:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414
2026-03-28 11:13:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 503f72bb-64fa-5a0d-b94d-40863b41395d with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 503f72bb-64fa-5a0d-b94d-40863b41395d with scrape type 2
2026-03-28 11:13:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 503f72bb-64fa-5a0d-b94d-40863b41395d, identifier: MS46414
2026-03-28 11:13:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with identifier: CE61200
2026-03-28 11:13:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with identifier: CE61200
2026-03-28 11:13:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64da2ce5-2ef0-5cd6-8910-8e346b8a16b3 with identifier: CE61200 to the API
2026-03-28 11:13:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:11:43Z',
 'fuel_type': 'diesel',
 'id': '64da2ce5-2ef0-5cd6-8910-8e346b8a16b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE61200',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 285801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-24',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2012}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE61200%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Saving data for CE61200: {'auction_closing_time': 1774714303.0, 'created_time': 1773402861.405778, 'last_price_update_time': 1774696432.134991}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE61200') HTTP/1.1" 204 0
2026-03-28 11:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414
2026-03-28 11:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414
2026-03-28 11:13:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 503f72bb-64fa-5a0d-b94d-40863b41395d with identifier: MS46414 to the API
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:12:19Z',
 'fuel_type': 'diesel',
 'id': '503f72bb-64fa-5a0d-b94d-40863b41395d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS46414',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 106636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-01-30',
 'seller_name': None,
 'title': 'Volvo C30 1.6 D Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2007}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Saving data for MS46414: {'auction_closing_time': 1774714339.0, 'created_time': 1772544816.353118, 'last_price_update_time': 1774696432.451193}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS46414') HTTP/1.1" 204 0
2026-03-28 11:13:52 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Scrape type for AE19293: 2
2026-03-28 11:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293
2026-03-28 11:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with scrape type 2
2026-03-28 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with scrape type 2
2026-03-28 11:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56, identifier: AE19293
2026-03-28 11:13:52 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-28 11:13:52 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Scrape type for LT68556: 2
2026-03-28 11:13:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556
2026-03-28 11:13:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with scrape type 2
2026-03-28 11:13:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with scrape type 2
2026-03-28 11:13:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a50451e-ab53-50ed-8c20-f2a44ca81a22, identifier: LT68556
2026-03-28 11:13:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293
2026-03-28 11:13:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293
2026-03-28 11:13:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24cdf4b6-0ff2-50c4-9ff7-b88c84864b56 with identifier: AE19293 to the API
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:12:48Z',
 'fuel_type': 'diesel',
 'id': '24cdf4b6-0ff2-50c4-9ff7-b88c84864b56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE19293',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 59267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-04',
 'seller_name': None,
 'title': 'Dacia Duster 1.5 Blue dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2021}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-28 11:13:52 [auto1.de] INFO: Saving data for AE19293: {'auction_closing_time': 1774714368.0, 'created_time': 1773303958.611126, 'last_price_update_time': 1774696432.952234}
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE19293') HTTP/1.1" 204 0
2026-03-28 11:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556
2026-03-28 11:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556
2026-03-28 11:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a50451e-ab53-50ed-8c20-f2a44ca81a22 with identifier: LT68556 to the API
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-28T16:32:32Z',
 'fuel_type': 'diesel',
 'id': '9a50451e-ab53-50ed-8c20-f2a44ca81a22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT68556',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 242542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-22',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-28 11:13:53 [auto1.de] INFO: Saving data for LT68556: {'auction_closing_time': 1774715552.0, 'created_time': 1774608517.035784, 'last_price_update_time': 1774696433.379138}
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT68556') HTTP/1.1" 204 0
2026-03-28 11:13:53 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-28 11:13:53 [auto1.de] INFO: Scrape type for PS95073: 2
2026-03-28 11:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073
2026-03-28 11:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66485b15-77cf-58d8-b686-73650737398a with scrape type 2
2026-03-28 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66485b15-77cf-58d8-b686-73650737398a with scrape type 2
2026-03-28 11:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66485b15-77cf-58d8-b686-73650737398a, identifier: PS95073
2026-03-28 11:13:53 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-28 11:13:53 [auto1.de] INFO: Scrape type for KF96010: 2
2026-03-28 11:13:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010
2026-03-28 11:13:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with scrape type 2
2026-03-28 11:13:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with scrape type 2
2026-03-28 11:13:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21, identifier: KF96010
2026-03-28 11:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073
2026-03-28 11:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073
2026-03-28 11:13:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66485b15-77cf-58d8-b686-73650737398a with identifier: PS95073 to the API
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 77,
 'expiration_date': '2026-03-28T16:10:51Z',
 'fuel_type': 'petrol',
 'id': '66485b15-77cf-58d8-b686-73650737398a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS95073',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto Evo',
 'odometer': 22143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-07',
 'seller_name': None,
 'title': 'Fiat Punto Evo 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-28 11:13:53 [auto1.de] INFO: Saving data for PS95073: {'auction_closing_time': 1774714251.0, 'created_time': 1774293402.954572, 'last_price_update_time': 1774696433.903501}
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS95073') HTTP/1.1" 204 0
2026-03-28 11:13:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010
2026-03-28 11:13:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010
2026-03-28 11:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21 with identifier: KF96010 to the API
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 326,
 'expiration_date': '2026-03-28T16:51:15Z',
 'fuel_type': 'hybrid',
 'id': '96e17aa2-0eb0-54d4-b17d-18f0e5b6ac21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF96010',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 61499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-22',
 'seller_name': None,
 'title': 'BMW 7er 740e L',
 'transmission': 'automatic',
 'trim': 'L',
 'year': 2017}
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-28 11:13:54 [auto1.de] INFO: Saving data for KF96010: {'auction_closing_time': 1774716675.0, 'created_time': 1773308230.26714, 'last_price_update_time': 1774696434.209393}
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF96010') HTTP/1.1" 204 0
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-28 11:13:54 [auto1.de] INFO: Scrape type for FV21429: 2
2026-03-28 11:13:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429
2026-03-28 11:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffbe1fad-6da1-58c2-a81d-eea7784a439f with scrape type 2
2026-03-28 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffbe1fad-6da1-58c2-a81d-eea7784a439f with scrape type 2
2026-03-28 11:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffbe1fad-6da1-58c2-a81d-eea7784a439f, identifier: FV21429
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-28 11:13:54 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-28 11:13:54 [auto1.de] INFO: Scrape type for PW65541: 2
2026-03-28 11:13:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541
2026-03-28 11:13:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6c019c7-4d81-59ad-8739-7977ca54f042 with scrape type 2
2026-03-28 11:13:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6c019c7-4d81-59ad-8739-7977ca54f042 with scrape type 2
2026-03-28 11:13:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6c019c7-4d81-59ad-8739-7977ca54f042, identifier: PW65541
2026-03-28 11:13:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429
2026-03-28 11:13:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429
2026-03-28 11:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffbe1fad-6da1-58c2-a81d-eea7784a439f with identifier: FV21429 to the API
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:08:10Z',
 'fuel_type': 'hybrid',
 'id': 'ffbe1fad-6da1-58c2-a81d-eea7784a439f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV21429',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 99531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-08',
 'seller_name': None,
 'title': 'Seat Tarraco 1.4 TSI e-HYBRID FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-28 11:13:54 [auto1.de] INFO: Saving data for FV21429: {'auction_closing_time': 1774714090.0, 'created_time': 1772543706.558235, 'last_price_update_time': 1774696434.746582}
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV21429') HTTP/1.1" 204 0
2026-03-28 11:13:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541
2026-03-28 11:13:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541
2026-03-28 11:13:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6c019c7-4d81-59ad-8739-7977ca54f042 with identifier: PW65541 to the API
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:55:20Z',
 'fuel_type': 'diesel',
 'id': 'a6c019c7-4d81-59ad-8739-7977ca54f042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW65541',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 329772,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-25',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2012}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Saving data for PW65541: {'auction_closing_time': 1774716920.0, 'created_time': 1774265294.143686, 'last_price_update_time': 1774696435.041796}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW65541') HTTP/1.1" 204 0
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Scrape type for PW98263: 2
2026-03-28 11:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263
2026-03-28 11:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd92968-1add-585a-8ddc-05fdc08056a1 with scrape type 2
2026-03-28 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cd92968-1add-585a-8ddc-05fdc08056a1 with scrape type 2
2026-03-28 11:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cd92968-1add-585a-8ddc-05fdc08056a1, identifier: PW98263
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Scrape type for JU04620: 2
2026-03-28 11:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620
2026-03-28 11:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with scrape type 2
2026-03-28 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with scrape type 2
2026-03-28 11:13:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 295ef3dd-2af7-55ec-9caf-674555bcf3d0, identifier: JU04620
2026-03-28 11:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263
2026-03-28 11:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263
2026-03-28 11:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cd92968-1add-585a-8ddc-05fdc08056a1 with identifier: PW98263 to the API
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:06:50Z',
 'fuel_type': 'petrol',
 'id': '6cd92968-1add-585a-8ddc-05fdc08056a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW98263',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 119518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Saving data for PW98263: {'auction_closing_time': 1774714010.0, 'created_time': 1773775262.30705, 'last_price_update_time': 1774696435.566014}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW98263') HTTP/1.1" 204 0
2026-03-28 11:13:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620
2026-03-28 11:13:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620
2026-03-28 11:13:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 295ef3dd-2af7-55ec-9caf-674555bcf3d0 with identifier: JU04620 to the API
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:10:09Z',
 'fuel_type': 'petrol',
 'id': '295ef3dd-2af7-55ec-9caf-674555bcf3d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU04620',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 135705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Saving data for JU04620: {'auction_closing_time': 1774714209.0, 'created_time': 1773858928.198178, 'last_price_update_time': 1774696435.946334}
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU04620') HTTP/1.1" 204 0
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-28 11:13:55 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-28 11:13:55 [auto1.de] INFO: Scrape type for DL69348: 2
2026-03-28 11:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348
2026-03-28 11:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ece55db-40b9-5ea8-911a-7c385298c104 with scrape type 2
2026-03-28 11:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ece55db-40b9-5ea8-911a-7c385298c104 with scrape type 2
2026-03-28 11:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ece55db-40b9-5ea8-911a-7c385298c104, identifier: DL69348
2026-03-28 11:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348
2026-03-28 11:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348
2026-03-28 11:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ece55db-40b9-5ea8-911a-7c385298c104 with identifier: DL69348 to the API
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 421,
 'expiration_date': '2026-03-28T16:42:15Z',
 'fuel_type': 'diesel',
 'id': '0ece55db-40b9-5ea8-911a-7c385298c104',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL69348',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 137317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-06',
 'seller_name': None,
 'title': 'Volkswagen Touareg 4.0 TDI Atmosphere 4Motion',
 'transmission': 'automatic',
 'trim': 'Atmosphere 4Motion',
 'year': 2020}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-28 11:13:56 [auto1.de] INFO: Saving data for DL69348: {'auction_closing_time': 1774716135.0, 'created_time': 1773305795.149433, 'last_price_update_time': 1774696436.40365}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL69348') HTTP/1.1" 204 0
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-28 11:13:56 [auto1.de] INFO: Scrape type for ZZ71304: 2
2026-03-28 11:13:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304
2026-03-28 11:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110572ef-11c3-5e40-afde-5b395c5fe3a4 with scrape type 2
2026-03-28 11:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 110572ef-11c3-5e40-afde-5b395c5fe3a4 with scrape type 2
2026-03-28 11:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 110572ef-11c3-5e40-afde-5b395c5fe3a4, identifier: ZZ71304
2026-03-28 11:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304
2026-03-28 11:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304
2026-03-28 11:13:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 110572ef-11c3-5e40-afde-5b395c5fe3a4 with identifier: ZZ71304 to the API
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:58:02Z',
 'fuel_type': 'petrol',
 'id': '110572ef-11c3-5e40-afde-5b395c5fe3a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ71304',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 114935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-28 11:13:56 [auto1.de] INFO: Saving data for ZZ71304: {'auction_closing_time': 1774717082.0, 'created_time': 1773861825.663401, 'last_price_update_time': 1774696436.834945}
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ71304') HTTP/1.1" 204 0
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: US46384
2026-03-28 11:13:56 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-28 11:13:56 [auto1.de] INFO: Scrape type for ZR48762: 2
2026-03-28 11:13:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762
2026-03-28 11:13:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a165d659-cf53-5485-8d8f-a7b809a13826 with scrape type 2
2026-03-28 11:13:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a165d659-cf53-5485-8d8f-a7b809a13826 with scrape type 2
2026-03-28 11:13:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a165d659-cf53-5485-8d8f-a7b809a13826, identifier: ZR48762
2026-03-28 11:13:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762
2026-03-28 11:13:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762
2026-03-28 11:13:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a165d659-cf53-5485-8d8f-a7b809a13826 with identifier: ZR48762 to the API
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:37:00Z',
 'fuel_type': 'petrol',
 'id': 'a165d659-cf53-5485-8d8f-a7b809a13826',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR48762',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 178540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 280 T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2007}
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-28 11:13:57 [auto1.de] INFO: Saving data for ZR48762: {'auction_closing_time': 1774715820.0, 'created_time': 1773427831.35327, 'last_price_update_time': 1774696437.242186}
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR48762') HTTP/1.1" 204 0
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-28 11:13:57 [auto1.de] INFO: Scrape type for MM29891: 2
2026-03-28 11:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891
2026-03-28 11:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with scrape type 2
2026-03-28 11:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with scrape type 2
2026-03-28 11:13:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2, identifier: MM29891
2026-03-28 11:13:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891
2026-03-28 11:13:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891
2026-03-28 11:13:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2 with identifier: MM29891 to the API
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:21:19Z',
 'fuel_type': 'diesel',
 'id': '8590f8d3-6df8-50e4-a6e6-4ea57a41dcc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM29891',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 77208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-28 11:13:57 [auto1.de] INFO: Saving data for MM29891: {'auction_closing_time': 1774714879.0, 'created_time': 1774293920.003838, 'last_price_update_time': 1774696437.719016}
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM29891') HTTP/1.1" 204 0
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-28 11:13:57 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-28 11:13:57 [auto1.de] INFO: Scrape type for AX34994: 2
2026-03-28 11:13:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994
2026-03-28 11:13:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d41989d1-c454-55c8-a89f-5beb9c4d5963 with scrape type 2
2026-03-28 11:13:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d41989d1-c454-55c8-a89f-5beb9c4d5963 with scrape type 2
2026-03-28 11:13:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d41989d1-c454-55c8-a89f-5beb9c4d5963, identifier: AX34994
2026-03-28 11:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:13:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994
2026-03-28 11:13:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994
2026-03-28 11:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d41989d1-c454-55c8-a89f-5beb9c4d5963 with identifier: AX34994 to the API
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:18:25Z',
 'fuel_type': 'diesel',
 'id': 'd41989d1-c454-55c8-a89f-5beb9c4d5963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX34994',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 114962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-28 11:13:58 [auto1.de] INFO: Saving data for AX34994: {'auction_closing_time': 1774714705.0, 'created_time': 1773382439.492193, 'last_price_update_time': 1774696438.250957}
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AX34994') HTTP/1.1" 204 0
2026-03-28 11:13:58 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-28 11:13:58 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-28 11:13:58 [auto1.de] INFO: Found listing with ID: PZ17668
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ17668%27 HTTP/1.1" 200 None
2026-03-28 11:13:58 [auto1.de] INFO: Scrape type for PZ17668: 2
2026-03-28 11:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19c8b7f1-9307-5d29-a989-6196049c4e18 with identifier: PZ17668
2026-03-28 11:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19c8b7f1-9307-5d29-a989-6196049c4e18 with scrape type 2
2026-03-28 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19c8b7f1-9307-5d29-a989-6196049c4e18 with scrape type 2
2026-03-28 11:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19c8b7f1-9307-5d29-a989-6196049c4e18, identifier: PZ17668
2026-03-28 11:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19c8b7f1-9307-5d29-a989-6196049c4e18 with identifier: PZ17668
2026-03-28 11:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19c8b7f1-9307-5d29-a989-6196049c4e18 with identifier: PZ17668
2026-03-28 11:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19c8b7f1-9307-5d29-a989-6196049c4e18 with identifier: PZ17668 to the API
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:13:21Z',
 'fuel_type': 'diesel',
 'id': '19c8b7f1-9307-5d29-a989-6196049c4e18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ17668',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 198302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-16',
 'seller_name': None,
 'title': 'Audi Q5 50 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ17668%27 HTTP/1.1" 200 None
2026-03-28 11:13:58 [auto1.de] INFO: Saving data for PZ17668: {'auction_closing_time': 1774714401.0, 'created_time': 1773686200.93384, 'last_price_update_time': 1774696438.768686}
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ17668') HTTP/1.1" 204 0
2026-03-28 11:13:58 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-28 11:13:58 [auto1.de] INFO: Scrape type for MY79904: 2
2026-03-28 11:13:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904
2026-03-28 11:13:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with scrape type 2
2026-03-28 11:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with scrape type 2
2026-03-28 11:13:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be, identifier: MY79904
2026-03-28 11:13:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904
2026-03-28 11:13:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904
2026-03-28 11:13:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79bbc902-3b1f-580e-a0e7-9c7c5f2182be with identifier: MY79904 to the API
2026-03-28 11:13:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-28T16:53:15Z',
 'fuel_type': 'hybrid',
 'id': '79bbc902-3b1f-580e-a0e7-9c7c5f2182be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY79904',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 202654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T8 Plug-in Hybrid R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2019}
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-28 11:13:59 [auto1.de] INFO: Saving data for MY79904: {'auction_closing_time': 1774716795.0, 'created_time': 1773861179.070441, 'last_price_update_time': 1774696439.189754}
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY79904') HTTP/1.1" 204 0
2026-03-28 11:13:59 [auto1.de] INFO: Channel: 24h | Page: 237 | totalHits: 9714 | hits on page: 40
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-28 11:13:59 [auto1.de] INFO: Scrape type for SK36887: 2
2026-03-28 11:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887
2026-03-28 11:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe976862-08ce-54f4-a9a7-2d63afbb4567 with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe976862-08ce-54f4-a9a7-2d63afbb4567 with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe976862-08ce-54f4-a9a7-2d63afbb4567, identifier: SK36887
2026-03-28 11:13:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887
2026-03-28 11:13:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887
2026-03-28 11:13:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe976862-08ce-54f4-a9a7-2d63afbb4567 with identifier: SK36887 to the API
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:13:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:16:11Z',
 'fuel_type': 'petrol',
 'id': 'fe976862-08ce-54f4-a9a7-2d63afbb4567',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK36887',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Eclipse Cross',
 'odometer': 81942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-25',
 'seller_name': None,
 'title': 'Mitsubishi Eclipse Cross 1.5 T-MIVEC Diamant Edition+ 4WD',
 'transmission': 'automatic',
 'trim': 'Diamant Edition+ 4WD',
 'year': 2019}
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-28 11:13:59 [auto1.de] INFO: Saving data for SK36887: {'auction_closing_time': 1774714571.0, 'created_time': 1773304653.377913, 'last_price_update_time': 1774696439.61435}
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK36887') HTTP/1.1" 204 0
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-28 11:13:59 [auto1.de] INFO: Scrape type for KP72135: 2
2026-03-28 11:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135
2026-03-28 11:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d13bf739-275b-5dcd-b228-9a5c2ebfe20e with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d13bf739-275b-5dcd-b228-9a5c2ebfe20e with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d13bf739-275b-5dcd-b228-9a5c2ebfe20e, identifier: KP72135
2026-03-28 11:13:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: AY58726
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-28 11:13:59 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-28 11:13:59 [auto1.de] INFO: Scrape type for SX14499: 2
2026-03-28 11:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499
2026-03-28 11:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with scrape type 2
2026-03-28 11:13:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb, identifier: SX14499
2026-03-28 11:13:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135
2026-03-28 11:13:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135
2026-03-28 11:13:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d13bf739-275b-5dcd-b228-9a5c2ebfe20e with identifier: KP72135 to the API
2026-03-28 11:13:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:03:30Z',
 'fuel_type': 'petrol',
 'id': 'd13bf739-275b-5dcd-b228-9a5c2ebfe20e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP72135',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 79414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-30',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.2 TCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2018}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Saving data for KP72135: {'auction_closing_time': 1774713810.0, 'created_time': 1773398843.753394, 'last_price_update_time': 1774696440.173238}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP72135') HTTP/1.1" 204 0
2026-03-28 11:14:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499
2026-03-28 11:14:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499
2026-03-28 11:14:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6da77647-6a9b-52f4-bdb9-d629b3ec6bbb with identifier: SX14499 to the API
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:54:53Z',
 'fuel_type': 'petrol',
 'id': '6da77647-6a9b-52f4-bdb9-d629b3ec6bbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX14499',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 47609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2021}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Saving data for SX14499: {'auction_closing_time': 1774716893.0, 'created_time': 1773383209.397009, 'last_price_update_time': 1774696440.475546}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX14499') HTTP/1.1" 204 0
2026-03-28 11:14:00 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-28 11:14:00 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Scrape type for UK53846: 2
2026-03-28 11:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846
2026-03-28 11:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with scrape type 2
2026-03-28 11:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with scrape type 2
2026-03-28 11:14:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6, identifier: UK53846
2026-03-28 11:14:00 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-28 11:14:00 [auto1.de] INFO: Found listing with ID: EF65370
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF65370%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Scrape type for EF65370: 2
2026-03-28 11:14:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8cb44a-aee9-57d4-aceb-98384cd313ce with identifier: EF65370
2026-03-28 11:14:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8cb44a-aee9-57d4-aceb-98384cd313ce with scrape type 2
2026-03-28 11:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa8cb44a-aee9-57d4-aceb-98384cd313ce with scrape type 2
2026-03-28 11:14:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa8cb44a-aee9-57d4-aceb-98384cd313ce, identifier: EF65370
2026-03-28 11:14:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846
2026-03-28 11:14:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846
2026-03-28 11:14:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f7401ab-5e10-5402-a6c8-c37fa7f68cb6 with identifier: UK53846 to the API
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:07:37Z',
 'fuel_type': 'petrol',
 'id': '7f7401ab-5e10-5402-a6c8-c37fa7f68cb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK53846',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 54342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2020}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-28 11:14:00 [auto1.de] INFO: Saving data for UK53846: {'auction_closing_time': 1774714057.0, 'created_time': 1774291040.363657, 'last_price_update_time': 1774696440.988361}
2026-03-28 11:14:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK53846') HTTP/1.1" 204 0
2026-03-28 11:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa8cb44a-aee9-57d4-aceb-98384cd313ce with identifier: EF65370
2026-03-28 11:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa8cb44a-aee9-57d4-aceb-98384cd313ce with identifier: EF65370
2026-03-28 11:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa8cb44a-aee9-57d4-aceb-98384cd313ce with identifier: EF65370 to the API
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-28T16:04:44Z',
 'fuel_type': 'diesel',
 'id': 'fa8cb44a-aee9-57d4-aceb-98384cd313ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF65370',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ7',
 'odometer': 59603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-12',
 'seller_name': None,
 'title': 'Audi SQ7 4.0 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF65370%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Saving data for EF65370: {'auction_closing_time': 1774713884.0, 'created_time': 1773302040.019792, 'last_price_update_time': 1774696441.37273}
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF65370') HTTP/1.1" 204 0
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Scrape type for FB84476: 2
2026-03-28 11:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476
2026-03-28 11:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 769549db-d892-59e7-93d8-e495c48928ce with scrape type 2
2026-03-28 11:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 769549db-d892-59e7-93d8-e495c48928ce with scrape type 2
2026-03-28 11:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 769549db-d892-59e7-93d8-e495c48928ce, identifier: FB84476
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-28 11:14:01 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Scrape type for MH69826: 2
2026-03-28 11:14:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826
2026-03-28 11:14:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3b8ddb2-9118-5795-9e70-c35dfed8b986 with scrape type 2
2026-03-28 11:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3b8ddb2-9118-5795-9e70-c35dfed8b986 with scrape type 2
2026-03-28 11:14:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3b8ddb2-9118-5795-9e70-c35dfed8b986, identifier: MH69826
2026-03-28 11:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476
2026-03-28 11:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476
2026-03-28 11:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 769549db-d892-59e7-93d8-e495c48928ce with identifier: FB84476 to the API
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:35:36Z',
 'fuel_type': 'petrol',
 'id': '769549db-d892-59e7-93d8-e495c48928ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB84476',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 144759,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-28 11:14:01 [auto1.de] INFO: Saving data for FB84476: {'auction_closing_time': 1774715736.0, 'created_time': 1773341611.653298, 'last_price_update_time': 1774696441.891031}
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB84476') HTTP/1.1" 204 0
2026-03-28 11:14:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826
2026-03-28 11:14:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826
2026-03-28 11:14:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3b8ddb2-9118-5795-9e70-c35dfed8b986 with identifier: MH69826 to the API
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:05Z',
 'fuel_type': 'petrol',
 'id': 'a3b8ddb2-9118-5795-9e70-c35dfed8b986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH69826',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 68421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.5 TSI ACT Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2023}
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-28 11:14:02 [auto1.de] INFO: Saving data for MH69826: {'auction_closing_time': 1774715825.0, 'created_time': 1773830790.420453, 'last_price_update_time': 1774696442.177607}
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH69826') HTTP/1.1" 204 0
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-28 11:14:02 [auto1.de] INFO: Scrape type for FS00408: 2
2026-03-28 11:14:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408
2026-03-28 11:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with scrape type 2
2026-03-28 11:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with scrape type 2
2026-03-28 11:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea, identifier: FS00408
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-28 11:14:02 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-28 11:14:02 [auto1.de] INFO: Scrape type for ER51805: 2
2026-03-28 11:14:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805
2026-03-28 11:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9d39367-cd17-51f1-a41e-d7c8af251282 with scrape type 2
2026-03-28 11:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9d39367-cd17-51f1-a41e-d7c8af251282 with scrape type 2
2026-03-28 11:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9d39367-cd17-51f1-a41e-d7c8af251282, identifier: ER51805
2026-03-28 11:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408
2026-03-28 11:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408
2026-03-28 11:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0e4d6eb-965b-5ee3-8193-f5b3332c0fea with identifier: FS00408 to the API
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-28T16:53:34Z',
 'fuel_type': 'petrol',
 'id': 'a0e4d6eb-965b-5ee3-8193-f5b3332c0fea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS00408',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 53248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-28 11:14:02 [auto1.de] INFO: Saving data for FS00408: {'auction_closing_time': 1774716814.0, 'created_time': 1774292936.275523, 'last_price_update_time': 1774696442.729409}
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS00408') HTTP/1.1" 204 0
2026-03-28 11:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805
2026-03-28 11:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805
2026-03-28 11:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9d39367-cd17-51f1-a41e-d7c8af251282 with identifier: ER51805 to the API
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:04:00Z',
 'fuel_type': 'petrol',
 'id': 'f9d39367-cd17-51f1-a41e-d7c8af251282',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER51805',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 43542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-28',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Saving data for ER51805: {'auction_closing_time': 1774713840.0, 'created_time': 1773383159.346075, 'last_price_update_time': 1774696443.11113}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER51805') HTTP/1.1" 204 0
2026-03-28 11:14:03 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Scrape type for KM30220: 2
2026-03-28 11:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220
2026-03-28 11:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4083ecd1-3298-5b57-950f-261d48ab49cf with scrape type 2
2026-03-28 11:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4083ecd1-3298-5b57-950f-261d48ab49cf with scrape type 2
2026-03-28 11:14:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4083ecd1-3298-5b57-950f-261d48ab49cf, identifier: KM30220
2026-03-28 11:14:03 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Scrape type for TW44182: 2
2026-03-28 11:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182
2026-03-28 11:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with scrape type 2
2026-03-28 11:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with scrape type 2
2026-03-28 11:14:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e2cb989-aea7-5d9f-80a9-95f8506662a2, identifier: TW44182
2026-03-28 11:14:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220
2026-03-28 11:14:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220
2026-03-28 11:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4083ecd1-3298-5b57-950f-261d48ab49cf with identifier: KM30220 to the API
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:35:31Z',
 'fuel_type': 'petrol',
 'id': '4083ecd1-3298-5b57-950f-261d48ab49cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM30220',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 243376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-16',
 'seller_name': None,
 'title': 'Audi A1 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Saving data for KM30220: {'auction_closing_time': 1774715731.0, 'created_time': 1773341525.447016, 'last_price_update_time': 1774696443.61479}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM30220') HTTP/1.1" 204 0
2026-03-28 11:14:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182
2026-03-28 11:14:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182
2026-03-28 11:14:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e2cb989-aea7-5d9f-80a9-95f8506662a2 with identifier: TW44182 to the API
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-28T16:33:01Z',
 'fuel_type': 'hybrid',
 'id': '2e2cb989-aea7-5d9f-80a9-95f8506662a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW44182',
 'listing': 'auction',
 'make': 'Lexus',
 'model': 'RX-Serie',
 'odometer': 129826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-15',
 'seller_name': None,
 'title': 'Lexus RX-Serie RX 450h Impression',
 'transmission': 'automatic',
 'trim': 'Impression',
 'year': 2010}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Saving data for TW44182: {'auction_closing_time': 1774715581.0, 'created_time': 1774608527.39522, 'last_price_update_time': 1774696443.913154}
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW44182') HTTP/1.1" 204 0
2026-03-28 11:14:03 [auto1.de] INFO: Found listing with ID: ZM90265
2026-03-28 11:14:03 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-28 11:14:03 [auto1.de] INFO: Scrape type for YS55163: 2
2026-03-28 11:14:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163
2026-03-28 11:14:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59314d11-3d3a-53a2-873c-52c843a5a3d7 with scrape type 2
2026-03-28 11:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59314d11-3d3a-53a2-873c-52c843a5a3d7 with scrape type 2
2026-03-28 11:14:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59314d11-3d3a-53a2-873c-52c843a5a3d7, identifier: YS55163
2026-03-28 11:14:04 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-28 11:14:04 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-28 11:14:04 [auto1.de] INFO: Scrape type for KP72135: 0
2026-03-28 11:14:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163
2026-03-28 11:14:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163
2026-03-28 11:14:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59314d11-3d3a-53a2-873c-52c843a5a3d7 with identifier: YS55163 to the API
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:39:41Z',
 'fuel_type': 'petrol',
 'id': '59314d11-3d3a-53a2-873c-52c843a5a3d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS55163',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Jogger',
 'odometer': 41237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-25',
 'seller_name': None,
 'title': 'Dacia Jogger 1.0 TCe Extreme+',
 'transmission': 'manual',
 'trim': 'Extreme+',
 'year': 2023}
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-28 11:14:04 [auto1.de] INFO: Saving data for YS55163: {'auction_closing_time': 1774715981.0, 'created_time': 1773946868.913418, 'last_price_update_time': 1774696444.383253}
2026-03-28 11:14:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS55163') HTTP/1.1" 204 0
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: XU02017
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU02017%27 HTTP/1.1" 200 None
2026-03-28 11:14:05 [auto1.de] INFO: Scrape type for XU02017: 2
2026-03-28 11:14:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 333517a7-9ca2-50fa-81fe-4be169d8b89d with identifier: XU02017
2026-03-28 11:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 333517a7-9ca2-50fa-81fe-4be169d8b89d with scrape type 2
2026-03-28 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 333517a7-9ca2-50fa-81fe-4be169d8b89d with scrape type 2
2026-03-28 11:14:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 333517a7-9ca2-50fa-81fe-4be169d8b89d, identifier: XU02017
2026-03-28 11:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 333517a7-9ca2-50fa-81fe-4be169d8b89d with identifier: XU02017
2026-03-28 11:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 333517a7-9ca2-50fa-81fe-4be169d8b89d with identifier: XU02017
2026-03-28 11:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 333517a7-9ca2-50fa-81fe-4be169d8b89d with identifier: XU02017 to the API
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-28T16:47:11Z',
 'fuel_type': 'petrol',
 'id': '333517a7-9ca2-50fa-81fe-4be169d8b89d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU02017',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 124011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-08-20',
 'seller_name': None,
 'title': 'BMW 3er 318Ci',
 'transmission': 'manual',
 'trim': '',
 'year': 2000}
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU02017%27 HTTP/1.1" 200 None
2026-03-28 11:14:05 [auto1.de] INFO: Saving data for XU02017: {'auction_closing_time': 1774716431.0, 'created_time': 1774608553.211322, 'last_price_update_time': 1774696445.537198}
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU02017') HTTP/1.1" 204 0
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-28 11:14:05 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-28 11:14:05 [auto1.de] INFO: Scrape type for PV05136: 2
2026-03-28 11:14:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136
2026-03-28 11:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c with scrape type 2
2026-03-28 11:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1bd4e256-9c3d-5f18-81f3-082a8445b94c with scrape type 2
2026-03-28 11:14:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1bd4e256-9c3d-5f18-81f3-082a8445b94c, identifier: PV05136
2026-03-28 11:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136
2026-03-28 11:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136
2026-03-28 11:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1bd4e256-9c3d-5f18-81f3-082a8445b94c with identifier: PV05136 to the API
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:33:51Z',
 'fuel_type': 'diesel',
 'id': '1bd4e256-9c3d-5f18-81f3-082a8445b94c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV05136',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 193793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-11',
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Turbodiesel Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-28 11:14:05 [auto1.de] INFO: Saving data for PV05136: {'auction_closing_time': 1774715631.0, 'created_time': 1774608553.594502, 'last_price_update_time': 1774696445.939491}
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV05136') HTTP/1.1" 204 0
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: EC48687
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: VC27283
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: RN45636
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN45636%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Scrape type for RN45636: 2
2026-03-28 11:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9324c65-06d3-597a-9b7f-5a45f7503fbd with identifier: RN45636
2026-03-28 11:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9324c65-06d3-597a-9b7f-5a45f7503fbd with scrape type 2
2026-03-28 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9324c65-06d3-597a-9b7f-5a45f7503fbd with scrape type 2
2026-03-28 11:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9324c65-06d3-597a-9b7f-5a45f7503fbd, identifier: RN45636
2026-03-28 11:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9324c65-06d3-597a-9b7f-5a45f7503fbd with identifier: RN45636
2026-03-28 11:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9324c65-06d3-597a-9b7f-5a45f7503fbd with identifier: RN45636
2026-03-28 11:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9324c65-06d3-597a-9b7f-5a45f7503fbd with identifier: RN45636 to the API
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-28T16:40:21Z',
 'fuel_type': 'diesel',
 'id': 'b9324c65-06d3-597a-9b7f-5a45f7503fbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN45636',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 324236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-06',
 'seller_name': None,
 'title': 'BMW X5 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN45636%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Saving data for RN45636: {'auction_closing_time': 1774716021.0, 'created_time': 1774608554.621551, 'last_price_update_time': 1774696446.458578}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN45636') HTTP/1.1" 204 0
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Scrape type for XG58500: 2
2026-03-28 11:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500
2026-03-28 11:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with scrape type 2
2026-03-28 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with scrape type 2
2026-03-28 11:14:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42, identifier: XG58500
2026-03-28 11:14:06 [scrapy.extensions.logstats] INFO: Crawled 453 pages (at 6 pages/min), scraped 1004 items (at 121 items/min)
2026-03-28 11:14:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:14:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500
2026-03-28 11:14:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500
2026-03-28 11:14:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0af9bfdb-44c0-542c-9938-0fe1aa99ed42 with identifier: XG58500 to the API
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:37:50Z',
 'fuel_type': 'petrol',
 'id': '0af9bfdb-44c0-542c-9938-0fe1aa99ed42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG58500',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 128302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-22',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 Celebration',
 'transmission': 'manual',
 'trim': 'Celebration',
 'year': 2016}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Saving data for XG58500: {'auction_closing_time': 1774715870.0, 'created_time': 1773137723.070419, 'last_price_update_time': 1774696446.886422}
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG58500') HTTP/1.1" 204 0
2026-03-28 11:14:06 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-28 11:14:06 [auto1.de] INFO: Scrape type for AE20511: 2
2026-03-28 11:14:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511
2026-03-28 11:14:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 434b8019-9dbb-5bd8-bdee-ea8338802c1f with scrape type 2
2026-03-28 11:14:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 434b8019-9dbb-5bd8-bdee-ea8338802c1f with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 434b8019-9dbb-5bd8-bdee-ea8338802c1f, identifier: AE20511
2026-03-28 11:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511
2026-03-28 11:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511
2026-03-28 11:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 434b8019-9dbb-5bd8-bdee-ea8338802c1f with identifier: AE20511 to the API
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:53:50Z',
 'fuel_type': 'petrol',
 'id': '434b8019-9dbb-5bd8-bdee-ea8338802c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE20511',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 79526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2018}
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-28 11:14:07 [auto1.de] INFO: Saving data for AE20511: {'auction_closing_time': 1774716830.0, 'created_time': 1774608551.404671, 'last_price_update_time': 1774696447.283391}
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE20511') HTTP/1.1" 204 0
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: RT05682
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-28 11:14:07 [auto1.de] INFO: Scrape type for EM07898: 2
2026-03-28 11:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898
2026-03-28 11:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06, identifier: EM07898
2026-03-28 11:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898
2026-03-28 11:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898
2026-03-28 11:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 450f596c-fd6c-5a87-9dd4-97fd03dd6f06 with identifier: EM07898 to the API
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:43:26Z',
 'fuel_type': 'diesel',
 'id': '450f596c-fd6c-5a87-9dd4-97fd03dd6f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM07898',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 217595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-28 11:14:07 [auto1.de] INFO: Saving data for EM07898: {'auction_closing_time': 1774716206.0, 'created_time': 1773343257.987719, 'last_price_update_time': 1774696447.688901}
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM07898') HTTP/1.1" 204 0
2026-03-28 11:14:07 [auto1.de] INFO: Found listing with ID: ZK76499
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK76499%27 HTTP/1.1" 200 None
2026-03-28 11:14:07 [auto1.de] INFO: Scrape type for ZK76499: 2
2026-03-28 11:14:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98406f2b-f0be-567c-993e-31d972116fd2 with identifier: ZK76499
2026-03-28 11:14:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98406f2b-f0be-567c-993e-31d972116fd2 with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98406f2b-f0be-567c-993e-31d972116fd2 with scrape type 2
2026-03-28 11:14:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98406f2b-f0be-567c-993e-31d972116fd2, identifier: ZK76499
2026-03-28 11:14:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98406f2b-f0be-567c-993e-31d972116fd2 with identifier: ZK76499
2026-03-28 11:14:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98406f2b-f0be-567c-993e-31d972116fd2 with identifier: ZK76499
2026-03-28 11:14:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98406f2b-f0be-567c-993e-31d972116fd2 with identifier: ZK76499 to the API
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:53:28Z',
 'fuel_type': 'diesel',
 'id': '98406f2b-f0be-567c-993e-31d972116fd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK76499',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 142280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-29',
 'seller_name': None,
 'title': 'Honda CR-V 1.6 DTEC Executive 4WD',
 'transmission': 'automatic',
 'trim': 'Executive 4WD',
 'year': 2015}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK76499%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Saving data for ZK76499: {'auction_closing_time': 1774716808.0, 'created_time': 1774608594.654458, 'last_price_update_time': 1774696448.109006}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK76499') HTTP/1.1" 204 0
2026-03-28 11:14:08 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Scrape type for NB76223: 2
2026-03-28 11:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223
2026-03-28 11:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4965aa78-b986-54e4-9159-09473ccee85c with scrape type 2
2026-03-28 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4965aa78-b986-54e4-9159-09473ccee85c with scrape type 2
2026-03-28 11:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4965aa78-b986-54e4-9159-09473ccee85c, identifier: NB76223
2026-03-28 11:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223
2026-03-28 11:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223
2026-03-28 11:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4965aa78-b986-54e4-9159-09473ccee85c with identifier: NB76223 to the API
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:58:28Z',
 'fuel_type': 'diesel',
 'id': '4965aa78-b986-54e4-9159-09473ccee85c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB76223',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 260843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-01',
 'seller_name': None,
 'title': 'Volkswagen Amarok 3.0 V6 TDI Aventura DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Aventura DoubleCab 4Motion',
 'year': 2020}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Saving data for NB76223: {'auction_closing_time': 1774717108.0, 'created_time': 1773946906.485409, 'last_price_update_time': 1774696448.496096}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB76223') HTTP/1.1" 204 0
2026-03-28 11:14:08 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Scrape type for VD78060: 2
2026-03-28 11:14:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060
2026-03-28 11:14:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85ed6daa-f18b-5a89-9a7f-552adeed03ea with scrape type 2
2026-03-28 11:14:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85ed6daa-f18b-5a89-9a7f-552adeed03ea with scrape type 2
2026-03-28 11:14:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85ed6daa-f18b-5a89-9a7f-552adeed03ea, identifier: VD78060
2026-03-28 11:14:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060
2026-03-28 11:14:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060
2026-03-28 11:14:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85ed6daa-f18b-5a89-9a7f-552adeed03ea with identifier: VD78060 to the API
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:39:19Z',
 'fuel_type': 'petrol',
 'id': '85ed6daa-f18b-5a89-9a7f-552adeed03ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD78060',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 119111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-31',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2009}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-28 11:14:08 [auto1.de] INFO: Saving data for VD78060: {'auction_closing_time': 1774715959.0, 'created_time': 1774608651.713168, 'last_price_update_time': 1774696448.973577}
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VD78060') HTTP/1.1" 204 0
2026-03-28 11:14:08 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-28 11:14:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-28 11:14:09 [auto1.de] INFO: Scrape type for AH76263: 2
2026-03-28 11:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263
2026-03-28 11:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9926c6-1a01-552a-83db-73be151299c7 with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a9926c6-1a01-552a-83db-73be151299c7 with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a9926c6-1a01-552a-83db-73be151299c7, identifier: AH76263
2026-03-28 11:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263
2026-03-28 11:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263
2026-03-28 11:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a9926c6-1a01-552a-83db-73be151299c7 with identifier: AH76263 to the API
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:02:09Z',
 'fuel_type': 'petrol',
 'id': '1a9926c6-1a01-552a-83db-73be151299c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH76263',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 41610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI ACT S line',
 'transmission': 'manual',
 'trim': 'ACT S line',
 'year': 2022}
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-28 11:14:09 [auto1.de] INFO: Saving data for AH76263: {'auction_closing_time': 1774713729.0, 'created_time': 1774608571.800093, 'last_price_update_time': 1774696449.360973}
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH76263') HTTP/1.1" 204 0
2026-03-28 11:14:09 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-28 11:14:09 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-28 11:14:09 [auto1.de] INFO: Scrape type for JZ27200: 2
2026-03-28 11:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200
2026-03-28 11:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae, identifier: JZ27200
2026-03-28 11:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200
2026-03-28 11:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200
2026-03-28 11:14:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae with identifier: JZ27200 to the API
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:23:43Z',
 'fuel_type': 'diesel',
 'id': '8ab699ce-252a-5b2a-a0bf-f07a0ea8a8ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ27200',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 198394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-28 11:14:09 [auto1.de] INFO: Saving data for JZ27200: {'auction_closing_time': 1774715023.0, 'created_time': 1774608578.564494, 'last_price_update_time': 1774696449.790163}
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ27200') HTTP/1.1" 204 0
2026-03-28 11:14:09 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-28 11:14:09 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-28 11:14:09 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-28 11:14:09 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-28 11:14:09 [auto1.de] INFO: Scrape type for WG01413: 2
2026-03-28 11:14:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413
2026-03-28 11:14:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96608814-f411-529b-a1a4-098b0d966baf with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96608814-f411-529b-a1a4-098b0d966baf with scrape type 2
2026-03-28 11:14:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96608814-f411-529b-a1a4-098b0d966baf, identifier: WG01413
2026-03-28 11:14:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413
2026-03-28 11:14:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413
2026-03-28 11:14:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96608814-f411-529b-a1a4-098b0d966baf with identifier: WG01413 to the API
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:26:09Z',
 'fuel_type': 'petrol',
 'id': '96608814-f411-529b-a1a4-098b0d966baf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG01413',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 64125,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2017}
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-28 11:14:10 [auto1.de] INFO: Saving data for WG01413: {'auction_closing_time': 1774715169.0, 'created_time': 1774034538.020237, 'last_price_update_time': 1774696450.218542}
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG01413') HTTP/1.1" 204 0
2026-03-28 11:14:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:14:13 [auto1.de] INFO: Channel: 24h | Page: 238 | totalHits: 9715 | hits on page: 40
2026-03-28 11:14:13 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-28 11:14:13 [auto1.de] INFO: Scrape type for WG01413: 0
2026-03-28 11:14:13 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-28 11:14:13 [auto1.de] INFO: Found listing with ID: MN31316
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN31316%27 HTTP/1.1" 200 None
2026-03-28 11:14:13 [auto1.de] INFO: Scrape type for MN31316: 2
2026-03-28 11:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c51cc63-c702-51ba-b09b-335dc906c6b2 with identifier: MN31316
2026-03-28 11:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c51cc63-c702-51ba-b09b-335dc906c6b2 with scrape type 2
2026-03-28 11:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c51cc63-c702-51ba-b09b-335dc906c6b2 with scrape type 2
2026-03-28 11:14:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c51cc63-c702-51ba-b09b-335dc906c6b2, identifier: MN31316
2026-03-28 11:14:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c51cc63-c702-51ba-b09b-335dc906c6b2 with identifier: MN31316
2026-03-28 11:14:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c51cc63-c702-51ba-b09b-335dc906c6b2 with identifier: MN31316
2026-03-28 11:14:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c51cc63-c702-51ba-b09b-335dc906c6b2 with identifier: MN31316 to the API
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:11:50Z',
 'fuel_type': 'diesel',
 'id': '4c51cc63-c702-51ba-b09b-335dc906c6b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN31316',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 212907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-25',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN31316%27 HTTP/1.1" 200 None
2026-03-28 11:14:13 [auto1.de] INFO: Saving data for MN31316: {'auction_closing_time': 1774714310.0, 'created_time': 1774608652.815334, 'last_price_update_time': 1774696453.852837}
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN31316') HTTP/1.1" 204 0
2026-03-28 11:14:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:14:13 [auto1.de] INFO: Found listing with ID: BJ91996
2026-03-28 11:14:13 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-28 11:14:13 [auto1.de] INFO: Scrape type for MV29238: 2
2026-03-28 11:14:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238
2026-03-28 11:14:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with scrape type 2
2026-03-28 11:14:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with scrape type 2
2026-03-28 11:14:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8, identifier: MV29238
2026-03-28 11:14:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238
2026-03-28 11:14:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238
2026-03-28 11:14:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 230e7d0c-7df9-58fe-bfd4-47e164e3c4c8 with identifier: MV29238 to the API
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:09Z',
 'fuel_type': 'petrol',
 'id': '230e7d0c-7df9-58fe-bfd4-47e164e3c4c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV29238',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 222173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-28 11:14:14 [auto1.de] INFO: Saving data for MV29238: {'auction_closing_time': 1774714809.0, 'created_time': 1774002542.443089, 'last_price_update_time': 1774696454.386404}
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV29238') HTTP/1.1" 204 0
2026-03-28 11:14:14 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-28 11:14:14 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-28 11:14:14 [auto1.de] INFO: Found listing with ID: ZZ67378
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ67378%27 HTTP/1.1" 200 None
2026-03-28 11:14:14 [auto1.de] INFO: Scrape type for ZZ67378: 2
2026-03-28 11:14:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eca5aac-39b2-5b93-af6a-b38550816051 with identifier: ZZ67378
2026-03-28 11:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eca5aac-39b2-5b93-af6a-b38550816051 with scrape type 2
2026-03-28 11:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eca5aac-39b2-5b93-af6a-b38550816051 with scrape type 2
2026-03-28 11:14:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2eca5aac-39b2-5b93-af6a-b38550816051, identifier: ZZ67378
2026-03-28 11:14:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2eca5aac-39b2-5b93-af6a-b38550816051 with identifier: ZZ67378
2026-03-28 11:14:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2eca5aac-39b2-5b93-af6a-b38550816051 with identifier: ZZ67378
2026-03-28 11:14:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2eca5aac-39b2-5b93-af6a-b38550816051 with identifier: ZZ67378 to the API
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:35:09Z',
 'fuel_type': 'diesel',
 'id': '2eca5aac-39b2-5b93-af6a-b38550816051',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ67378',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 175932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-14',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 310 L2 Einzelkabine',
 'transmission': 'manual',
 'trim': '310 L2 Einzelkabine',
 'year': 2014}
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ67378%27 HTTP/1.1" 200 None
2026-03-28 11:14:14 [auto1.de] INFO: Saving data for ZZ67378: {'auction_closing_time': 1774715709.0, 'created_time': 1774608582.222404, 'last_price_update_time': 1774696454.817807}
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ67378') HTTP/1.1" 204 0
2026-03-28 11:14:14 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-28 11:14:14 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-28 11:14:14 [auto1.de] INFO: Scrape type for DP29257: 2
2026-03-28 11:14:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257
2026-03-28 11:14:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd with scrape type 2
2026-03-28 11:14:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84c9788e-a100-5c3f-a035-b8bc1364dbcd with scrape type 2
2026-03-28 11:14:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84c9788e-a100-5c3f-a035-b8bc1364dbcd, identifier: DP29257
2026-03-28 11:14:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257
2026-03-28 11:14:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257
2026-03-28 11:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84c9788e-a100-5c3f-a035-b8bc1364dbcd with identifier: DP29257 to the API
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:50:10Z',
 'fuel_type': 'diesel',
 'id': '84c9788e-a100-5c3f-a035-b8bc1364dbcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP29257',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 182968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-11',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-28 11:14:15 [auto1.de] INFO: Saving data for DP29257: {'auction_closing_time': 1774716610.0, 'created_time': 1774608605.37909, 'last_price_update_time': 1774696455.210696}
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP29257') HTTP/1.1" 204 0
2026-03-28 11:14:15 [auto1.de] INFO: Found listing with ID: NB18835
2026-03-28 11:14:15 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-28 11:14:15 [auto1.de] INFO: Scrape type for AB91647: 2
2026-03-28 11:14:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647
2026-03-28 11:14:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82514085-ea9c-5a21-a143-2bb590533a6a with scrape type 2
2026-03-28 11:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82514085-ea9c-5a21-a143-2bb590533a6a with scrape type 2
2026-03-28 11:14:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82514085-ea9c-5a21-a143-2bb590533a6a, identifier: AB91647
2026-03-28 11:14:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647
2026-03-28 11:14:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647
2026-03-28 11:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82514085-ea9c-5a21-a143-2bb590533a6a with identifier: AB91647 to the API
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:52:20Z',
 'fuel_type': 'petrol',
 'id': '82514085-ea9c-5a21-a143-2bb590533a6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB91647',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 49148,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-23',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style Copa Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Copa Ecomotive',
 'year': 2012}
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-28 11:14:15 [auto1.de] INFO: Saving data for AB91647: {'auction_closing_time': 1774716740.0, 'created_time': 1773946002.100934, 'last_price_update_time': 1774696455.656547}
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB91647') HTTP/1.1" 204 0
2026-03-28 11:14:15 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-28 11:14:15 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-28 11:14:15 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-28 11:14:15 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-28 11:14:15 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-28 11:14:15 [auto1.de] INFO: Scrape type for DE97424: 2
2026-03-28 11:14:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424
2026-03-28 11:14:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3606559e-1b44-59b2-9815-d525fe678338 with scrape type 2
2026-03-28 11:14:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3606559e-1b44-59b2-9815-d525fe678338 with scrape type 2
2026-03-28 11:14:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3606559e-1b44-59b2-9815-d525fe678338, identifier: DE97424
2026-03-28 11:14:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424
2026-03-28 11:14:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424
2026-03-28 11:14:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3606559e-1b44-59b2-9815-d525fe678338 with identifier: DE97424 to the API
2026-03-28 11:14:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:35:08Z',
 'fuel_type': 'diesel',
 'id': '3606559e-1b44-59b2-9815-d525fe678338',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE97424',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 225783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2013}
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-28 11:14:16 [auto1.de] INFO: Saving data for DE97424: {'auction_closing_time': 1774715708.0, 'created_time': 1773137287.788719, 'last_price_update_time': 1774696456.183066}
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE97424') HTTP/1.1" 204 0
2026-03-28 11:14:16 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-28 11:14:16 [auto1.de] INFO: Scrape type for VU87810: 2
2026-03-28 11:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810
2026-03-28 11:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2966244-205c-5a48-8407-8c2f6b4a6763 with scrape type 2
2026-03-28 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2966244-205c-5a48-8407-8c2f6b4a6763 with scrape type 2
2026-03-28 11:14:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2966244-205c-5a48-8407-8c2f6b4a6763, identifier: VU87810
2026-03-28 11:14:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810
2026-03-28 11:14:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810
2026-03-28 11:14:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2966244-205c-5a48-8407-8c2f6b4a6763 with identifier: VU87810 to the API
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:58:48Z',
 'fuel_type': 'diesel',
 'id': 'd2966244-205c-5a48-8407-8c2f6b4a6763',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU87810',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 188480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro Plus',
 'transmission': 'automatic',
 'trim': 'quattro Plus',
 'year': 2016}
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-28 11:14:16 [auto1.de] INFO: Saving data for VU87810: {'auction_closing_time': 1774717128.0, 'created_time': 1773307341.11041, 'last_price_update_time': 1774696456.908903}
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU87810') HTTP/1.1" 204 0
2026-03-28 11:14:16 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-28 11:14:16 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-28 11:14:16 [auto1.de] INFO: Scrape type for TN35459: 2
2026-03-28 11:14:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459
2026-03-28 11:14:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with scrape type 2
2026-03-28 11:14:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with scrape type 2
2026-03-28 11:14:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4, identifier: TN35459
2026-03-28 11:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459
2026-03-28 11:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459
2026-03-28 11:14:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4 with identifier: TN35459 to the API
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:28:54Z',
 'fuel_type': 'petrol',
 'id': '80ebdf59-f1e7-537d-bbd5-f8acd2f59dc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN35459',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '323',
 'odometer': 80891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-12-06',
 'seller_name': None,
 'title': 'Mazda 323 1.6 F Exclusive',
 'transmission': 'manual',
 'trim': 'F Exclusive',
 'year': 2001}
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-28 11:14:17 [auto1.de] INFO: Saving data for TN35459: {'auction_closing_time': 1774715334.0, 'created_time': 1774608570.271162, 'last_price_update_time': 1774696457.363304}
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN35459') HTTP/1.1" 204 0
2026-03-28 11:14:17 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-28 11:14:17 [auto1.de] INFO: Scrape type for YT23493: 2
2026-03-28 11:14:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493
2026-03-28 11:14:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261ba68c-bdfc-5869-8653-b5da35019a0f with scrape type 2
2026-03-28 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261ba68c-bdfc-5869-8653-b5da35019a0f with scrape type 2
2026-03-28 11:14:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 261ba68c-bdfc-5869-8653-b5da35019a0f, identifier: YT23493
2026-03-28 11:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493
2026-03-28 11:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493
2026-03-28 11:14:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 261ba68c-bdfc-5869-8653-b5da35019a0f with identifier: YT23493 to the API
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:42:32Z',
 'fuel_type': 'diesel',
 'id': '261ba68c-bdfc-5869-8653-b5da35019a0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT23493',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 257620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-31',
 'seller_name': None,
 'title': 'BMW 1er 123d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-28 11:14:17 [auto1.de] INFO: Saving data for YT23493: {'auction_closing_time': 1774716152.0, 'created_time': 1773228656.593994, 'last_price_update_time': 1774696457.851761}
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT23493') HTTP/1.1" 204 0
2026-03-28 11:14:17 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-28 11:14:17 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-28 11:14:17 [auto1.de] INFO: Scrape type for SG45396: 2
2026-03-28 11:14:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396
2026-03-28 11:14:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65b14690-fdc5-55ad-a2e2-b11dc317f145 with scrape type 2
2026-03-28 11:14:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65b14690-fdc5-55ad-a2e2-b11dc317f145 with scrape type 2
2026-03-28 11:14:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65b14690-fdc5-55ad-a2e2-b11dc317f145, identifier: SG45396
2026-03-28 11:14:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396
2026-03-28 11:14:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396
2026-03-28 11:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65b14690-fdc5-55ad-a2e2-b11dc317f145 with identifier: SG45396 to the API
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:25:48Z',
 'fuel_type': 'petrol',
 'id': '65b14690-fdc5-55ad-a2e2-b11dc317f145',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG45396',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 157871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-29',
 'seller_name': None,
 'title': 'Mazda 5 1.8 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-28 11:14:18 [auto1.de] INFO: Saving data for SG45396: {'auction_closing_time': 1774715148.0, 'created_time': 1774608579.644029, 'last_price_update_time': 1774696458.257621}
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG45396') HTTP/1.1" 204 0
2026-03-28 11:14:18 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-28 11:14:18 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-28 11:14:18 [auto1.de] INFO: Scrape type for MV46979: 2
2026-03-28 11:14:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979
2026-03-28 11:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f9d0c6b-fb03-5824-9546-47daf1064832 with scrape type 2
2026-03-28 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f9d0c6b-fb03-5824-9546-47daf1064832 with scrape type 2
2026-03-28 11:14:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f9d0c6b-fb03-5824-9546-47daf1064832, identifier: MV46979
2026-03-28 11:14:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:14:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979
2026-03-28 11:14:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979
2026-03-28 11:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f9d0c6b-fb03-5824-9546-47daf1064832 with identifier: MV46979 to the API
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:31:48Z',
 'fuel_type': 'petrol',
 'id': '8f9d0c6b-fb03-5824-9546-47daf1064832',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV46979',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 119885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-28',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2014}
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-28 11:14:18 [auto1.de] INFO: Saving data for MV46979: {'auction_closing_time': 1774715508.0, 'created_time': 1774608575.467988, 'last_price_update_time': 1774696458.625439}
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV46979') HTTP/1.1" 204 0
2026-03-28 11:14:18 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-28 11:14:18 [auto1.de] INFO: Scrape type for ZV10923: 2
2026-03-28 11:14:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923
2026-03-28 11:14:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with scrape type 2
2026-03-28 11:14:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with scrape type 2
2026-03-28 11:14:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad, identifier: ZV10923
2026-03-28 11:14:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923
2026-03-28 11:14:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923
2026-03-28 11:14:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad with identifier: ZV10923 to the API
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:31:09Z',
 'fuel_type': 'petrol',
 'id': '998b1395-1c50-5f2d-b4fb-e2a4d3a4d7ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV10923',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 25746,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-05',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Collezione',
 'transmission': 'manual',
 'trim': 'Collezione',
 'year': 2018}
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-28 11:14:19 [auto1.de] INFO: Saving data for ZV10923: {'auction_closing_time': 1774715469.0, 'created_time': 1774608608.022005, 'last_price_update_time': 1774696459.025327}
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV10923') HTTP/1.1" 204 0
2026-03-28 11:14:19 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-28 11:14:19 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-28 11:14:19 [auto1.de] INFO: Scrape type for ZY72717: 2
2026-03-28 11:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717
2026-03-28 11:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with scrape type 2
2026-03-28 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with scrape type 2
2026-03-28 11:14:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9, identifier: ZY72717
2026-03-28 11:14:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717
2026-03-28 11:14:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717
2026-03-28 11:14:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9 with identifier: ZY72717 to the API
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 83,
 'expiration_date': '2026-03-28T16:59:11Z',
 'fuel_type': 'petrol',
 'id': '7218de36-c9b7-5f9b-b7f3-b8a557d5d8e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY72717',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 126249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.6 Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2013}
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-28 11:14:19 [auto1.de] INFO: Saving data for ZY72717: {'auction_closing_time': 1774717151.0, 'created_time': 1774608566.910485, 'last_price_update_time': 1774696459.433417}
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY72717') HTTP/1.1" 204 0
2026-03-28 11:14:19 [auto1.de] INFO: Channel: 24h | Page: 239 | totalHits: 9715 | hits on page: 40
2026-03-28 11:14:19 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-28 11:14:19 [auto1.de] INFO: Scrape type for CY44920: 2
2026-03-28 11:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920
2026-03-28 11:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 051cef2e-b623-5c8c-9616-1169f7535060 with scrape type 2
2026-03-28 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 051cef2e-b623-5c8c-9616-1169f7535060 with scrape type 2
2026-03-28 11:14:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 051cef2e-b623-5c8c-9616-1169f7535060, identifier: CY44920
2026-03-28 11:14:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920
2026-03-28 11:14:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920
2026-03-28 11:14:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 051cef2e-b623-5c8c-9616-1169f7535060 with identifier: CY44920 to the API
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:50:04Z',
 'fuel_type': 'diesel',
 'id': '051cef2e-b623-5c8c-9616-1169f7535060',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY44920',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 172904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-01',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D4 Inscription',
 'transmission': 'automatic',
 'trim': 'Inscription',
 'year': 2018}
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-28 11:14:19 [auto1.de] INFO: Saving data for CY44920: {'auction_closing_time': 1774716604.0, 'created_time': 1774608733.908771, 'last_price_update_time': 1774696459.931281}
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY44920') HTTP/1.1" 204 0
2026-03-28 11:14:19 [auto1.de] INFO: Found listing with ID: ML66978
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML66978%27 HTTP/1.1" 200 None
2026-03-28 11:14:19 [auto1.de] INFO: Scrape type for ML66978: 2
2026-03-28 11:14:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a352f7-e34b-593f-9e75-838c9a9b8db1 with identifier: ML66978
2026-03-28 11:14:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a352f7-e34b-593f-9e75-838c9a9b8db1 with scrape type 2
2026-03-28 11:14:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91a352f7-e34b-593f-9e75-838c9a9b8db1 with scrape type 2
2026-03-28 11:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91a352f7-e34b-593f-9e75-838c9a9b8db1, identifier: ML66978
2026-03-28 11:14:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:14:20 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-28 11:14:20 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-28 11:14:20 [auto1.de] INFO: Scrape type for DV32986: 2
2026-03-28 11:14:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986
2026-03-28 11:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with scrape type 2
2026-03-28 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with scrape type 2
2026-03-28 11:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944, identifier: DV32986
2026-03-28 11:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91a352f7-e34b-593f-9e75-838c9a9b8db1 with identifier: ML66978
2026-03-28 11:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91a352f7-e34b-593f-9e75-838c9a9b8db1 with identifier: ML66978
2026-03-28 11:14:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91a352f7-e34b-593f-9e75-838c9a9b8db1 with identifier: ML66978 to the API
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:55:47Z',
 'fuel_type': 'diesel',
 'id': '91a352f7-e34b-593f-9e75-838c9a9b8db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML66978',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 278476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-30',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 109 CDI Lang',
 'transmission': 'manual',
 'trim': 'Lang',
 'year': 2012}
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML66978%27 HTTP/1.1" 200 None
2026-03-28 11:14:20 [auto1.de] INFO: Saving data for ML66978: {'auction_closing_time': 1774716947.0, 'created_time': 1774608815.685424, 'last_price_update_time': 1774696460.437636}
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML66978') HTTP/1.1" 204 0
2026-03-28 11:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986
2026-03-28 11:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986
2026-03-28 11:14:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d50fd0-7194-5dd9-a7a5-09d00fa6f944 with identifier: DV32986 to the API
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-28T16:23:09Z',
 'fuel_type': 'petrol',
 'id': 'c3d50fd0-7194-5dd9-a7a5-09d00fa6f944',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV32986',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 150564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-13',
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-28 11:14:20 [auto1.de] INFO: Saving data for DV32986: {'auction_closing_time': 1774714989.0, 'created_time': 1774608579.247262, 'last_price_update_time': 1774696460.731073}
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV32986') HTTP/1.1" 204 0
2026-03-28 11:14:20 [auto1.de] INFO: Found listing with ID: CJ75930
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75930%27 HTTP/1.1" 200 None
2026-03-28 11:14:20 [auto1.de] INFO: Scrape type for CJ75930: 2
2026-03-28 11:14:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed6a0c4-c637-5a98-9456-c360b66a475a with identifier: CJ75930
2026-03-28 11:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed6a0c4-c637-5a98-9456-c360b66a475a with scrape type 2
2026-03-28 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ed6a0c4-c637-5a98-9456-c360b66a475a with scrape type 2
2026-03-28 11:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ed6a0c4-c637-5a98-9456-c360b66a475a, identifier: CJ75930
2026-03-28 11:14:20 [auto1.de] INFO: Found listing with ID: CC90437
2026-03-28 11:14:20 [auto1.de] INFO: Found listing with ID: SM08668
2026-03-28 11:14:20 [auto1.de] INFO: Found listing with ID: ND31150
2026-03-28 11:14:20 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-28 11:14:20 [auto1.de] INFO: Scrape type for CB12842: 2
2026-03-28 11:14:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842
2026-03-28 11:14:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a03ca11-e6e7-514f-a307-38831f84618b with scrape type 2
2026-03-28 11:14:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a03ca11-e6e7-514f-a307-38831f84618b with scrape type 2
2026-03-28 11:14:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a03ca11-e6e7-514f-a307-38831f84618b, identifier: CB12842
2026-03-28 11:14:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ed6a0c4-c637-5a98-9456-c360b66a475a with identifier: CJ75930
2026-03-28 11:14:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ed6a0c4-c637-5a98-9456-c360b66a475a with identifier: CJ75930
2026-03-28 11:14:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ed6a0c4-c637-5a98-9456-c360b66a475a with identifier: CJ75930 to the API
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 114,
 'expiration_date': '2026-03-28T16:28:31Z',
 'fuel_type': 'petrol',
 'id': '8ed6a0c4-c637-5a98-9456-c360b66a475a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ75930',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 106016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2019}
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75930%27 HTTP/1.1" 200 None
2026-03-28 11:14:21 [auto1.de] INFO: Saving data for CJ75930: {'auction_closing_time': 1774715311.0, 'created_time': 1774608716.167094, 'last_price_update_time': 1774696461.249298}
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ75930') HTTP/1.1" 204 0
2026-03-28 11:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842
2026-03-28 11:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842
2026-03-28 11:14:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a03ca11-e6e7-514f-a307-38831f84618b with identifier: CB12842 to the API
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:47:47Z',
 'fuel_type': 'petrol',
 'id': '9a03ca11-e6e7-514f-a307-38831f84618b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB12842',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 187814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-28 11:14:21 [auto1.de] INFO: Saving data for CB12842: {'auction_closing_time': 1774716467.0, 'created_time': 1774608714.080222, 'last_price_update_time': 1774696461.604632}
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB12842') HTTP/1.1" 204 0
2026-03-28 11:14:21 [auto1.de] INFO: Found listing with ID: XW49468
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW49468%27 HTTP/1.1" 200 None
2026-03-28 11:14:21 [auto1.de] INFO: Scrape type for XW49468: 2
2026-03-28 11:14:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8df1793-d5eb-5d40-91af-bfe9d057e714 with identifier: XW49468
2026-03-28 11:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8df1793-d5eb-5d40-91af-bfe9d057e714 with scrape type 2
2026-03-28 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8df1793-d5eb-5d40-91af-bfe9d057e714 with scrape type 2
2026-03-28 11:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8df1793-d5eb-5d40-91af-bfe9d057e714, identifier: XW49468
2026-03-28 11:14:21 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-28 11:14:21 [auto1.de] INFO: Found listing with ID: UZ74086
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ74086%27 HTTP/1.1" 200 None
2026-03-28 11:14:21 [auto1.de] INFO: Scrape type for UZ74086: 2
2026-03-28 11:14:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with identifier: UZ74086
2026-03-28 11:14:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with scrape type 2
2026-03-28 11:14:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with scrape type 2
2026-03-28 11:14:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225, identifier: UZ74086
2026-03-28 11:14:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8df1793-d5eb-5d40-91af-bfe9d057e714 with identifier: XW49468
2026-03-28 11:14:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8df1793-d5eb-5d40-91af-bfe9d057e714 with identifier: XW49468
2026-03-28 11:14:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8df1793-d5eb-5d40-91af-bfe9d057e714 with identifier: XW49468 to the API
2026-03-28 11:14:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:48:29Z',
 'fuel_type': 'petrol',
 'id': 'e8df1793-d5eb-5d40-91af-bfe9d057e714',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW49468',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 96990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-22',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW49468%27 HTTP/1.1" 200 None
2026-03-28 11:14:22 [auto1.de] INFO: Saving data for XW49468: {'auction_closing_time': 1774716509.0, 'created_time': 1774608716.974683, 'last_price_update_time': 1774696462.118007}
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW49468') HTTP/1.1" 204 0
2026-03-28 11:14:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with identifier: UZ74086
2026-03-28 11:14:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with identifier: UZ74086
2026-03-28 11:14:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c171c7a-9b8d-585a-b1b9-d8f0b3f05225 with identifier: UZ74086 to the API
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:30:30Z',
 'fuel_type': 'petrol',
 'id': '5c171c7a-9b8d-585a-b1b9-d8f0b3f05225',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ74086',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTI BlueMotion Tech',
 'year': 2014}
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ74086%27 HTTP/1.1" 200 None
2026-03-28 11:14:22 [auto1.de] INFO: Saving data for UZ74086: {'auction_closing_time': 1774715430.0, 'created_time': 1774608707.351521, 'last_price_update_time': 1774696462.482325}
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ74086') HTTP/1.1" 204 0
2026-03-28 11:14:22 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-28 11:14:22 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-28 11:14:22 [auto1.de] INFO: Scrape type for PC62397: 2
2026-03-28 11:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397
2026-03-28 11:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2dc4ca7-d578-5e38-9e27-d40533f5c795 with scrape type 2
2026-03-28 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2dc4ca7-d578-5e38-9e27-d40533f5c795 with scrape type 2
2026-03-28 11:14:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2dc4ca7-d578-5e38-9e27-d40533f5c795, identifier: PC62397
2026-03-28 11:14:22 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-28 11:14:22 [auto1.de] INFO: Scrape type for UT27249: 2
2026-03-28 11:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249
2026-03-28 11:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b59a7cea-af21-5908-bdc4-bd25df04a4db with scrape type 2
2026-03-28 11:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b59a7cea-af21-5908-bdc4-bd25df04a4db with scrape type 2
2026-03-28 11:14:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b59a7cea-af21-5908-bdc4-bd25df04a4db, identifier: UT27249
2026-03-28 11:14:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397
2026-03-28 11:14:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397
2026-03-28 11:14:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2dc4ca7-d578-5e38-9e27-d40533f5c795 with identifier: PC62397 to the API
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-28T16:12:15Z',
 'fuel_type': 'petrol',
 'id': 'f2dc4ca7-d578-5e38-9e27-d40533f5c795',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC62397',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 119149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-03',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-28 11:14:22 [auto1.de] INFO: Saving data for PC62397: {'auction_closing_time': 1774714335.0, 'created_time': 1774381067.864226, 'last_price_update_time': 1774696462.997491}
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC62397') HTTP/1.1" 204 0
2026-03-28 11:14:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249
2026-03-28 11:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249
2026-03-28 11:14:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b59a7cea-af21-5908-bdc4-bd25df04a4db with identifier: UT27249 to the API
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:58:12Z',
 'fuel_type': 'petrol',
 'id': 'b59a7cea-af21-5908-bdc4-bd25df04a4db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT27249',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 122874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-28 11:14:23 [auto1.de] INFO: Saving data for UT27249: {'auction_closing_time': 1774717092.0, 'created_time': 1774608789.086783, 'last_price_update_time': 1774696463.304673}
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT27249') HTTP/1.1" 204 0
2026-03-28 11:14:23 [auto1.de] INFO: Found listing with ID: MX32750
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX32750%27 HTTP/1.1" 200 None
2026-03-28 11:14:23 [auto1.de] INFO: Scrape type for MX32750: 2
2026-03-28 11:14:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with identifier: MX32750
2026-03-28 11:14:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with scrape type 2
2026-03-28 11:14:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with scrape type 2
2026-03-28 11:14:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28d0485f-6f00-5e44-befc-b2c3cfd474d7, identifier: MX32750
2026-03-28 11:14:23 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-28 11:14:23 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-28 11:14:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with identifier: MX32750
2026-03-28 11:14:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with identifier: MX32750
2026-03-28 11:14:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28d0485f-6f00-5e44-befc-b2c3cfd474d7 with identifier: MX32750 to the API
2026-03-28 11:14:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-28T16:14:09Z',
 'fuel_type': 'diesel',
 'id': '28d0485f-6f00-5e44-befc-b2c3cfd474d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX32750',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 248448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-24',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX32750%27 HTTP/1.1" 200 None
2026-03-28 11:14:24 [auto1.de] INFO: Saving data for MX32750: {'auction_closing_time': 1774714449.0, 'created_time': 1774291761.918241, 'last_price_update_time': 1774696464.347028}
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX32750') HTTP/1.1" 204 0
2026-03-28 11:14:24 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-28 11:14:24 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-28 11:14:24 [auto1.de] INFO: Scrape type for RA07752: 2
2026-03-28 11:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752
2026-03-28 11:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with scrape type 2
2026-03-28 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with scrape type 2
2026-03-28 11:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cc68881-27cf-58d2-8d57-2c290ae3eb12, identifier: RA07752
2026-03-28 11:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752
2026-03-28 11:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752
2026-03-28 11:14:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cc68881-27cf-58d2-8d57-2c290ae3eb12 with identifier: RA07752 to the API
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:14:30Z',
 'fuel_type': 'petrol',
 'id': '1cc68881-27cf-58d2-8d57-2c290ae3eb12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA07752',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 70640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2017}
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-28 11:14:24 [auto1.de] INFO: Saving data for RA07752: {'auction_closing_time': 1774714470.0, 'created_time': 1774608592.55816, 'last_price_update_time': 1774696464.7549}
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA07752') HTTP/1.1" 204 0
2026-03-28 11:14:24 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-28 11:14:24 [auto1.de] INFO: Found listing with ID: WF06816
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF06816%27 HTTP/1.1" 200 None
2026-03-28 11:14:24 [auto1.de] INFO: Scrape type for WF06816: 2
2026-03-28 11:14:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: WF06816
2026-03-28 11:14:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6f353d6-f828-52d6-8f35-8ce9b635c49d with scrape type 2
2026-03-28 11:14:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6f353d6-f828-52d6-8f35-8ce9b635c49d with scrape type 2
2026-03-28 11:14:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6f353d6-f828-52d6-8f35-8ce9b635c49d, identifier: WF06816
2026-03-28 11:14:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: WF06816
2026-03-28 11:14:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: WF06816
2026-03-28 11:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6f353d6-f828-52d6-8f35-8ce9b635c49d with identifier: WF06816 to the API
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-28T16:31:55Z',
 'fuel_type': 'electro',
 'id': 'c6f353d6-f828-52d6-8f35-8ce9b635c49d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF06816',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Spring',
 'odometer': 13,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-12-18',
 'seller_name': None,
 'title': 'Dacia Spring electric drive 48 kW Extreme',
 'transmission': 'automatic',
 'trim': 'Extreme',
 'year': 2025}
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF06816%27 HTTP/1.1" 200 None
2026-03-28 11:14:25 [auto1.de] INFO: Saving data for WF06816: {'auction_closing_time': 1774715515.0, 'created_time': 1774608577.591837, 'last_price_update_time': 1774696465.2044}
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF06816') HTTP/1.1" 204 0
2026-03-28 11:14:25 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-28 11:14:25 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-28 11:14:25 [auto1.de] INFO: Found listing with ID: XV66825
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV66825%27 HTTP/1.1" 200 None
2026-03-28 11:14:25 [auto1.de] INFO: Scrape type for XV66825: 2
2026-03-28 11:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57d6148c-6d35-533b-9614-6b7c45ebfac6 with identifier: XV66825
2026-03-28 11:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57d6148c-6d35-533b-9614-6b7c45ebfac6 with scrape type 2
2026-03-28 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57d6148c-6d35-533b-9614-6b7c45ebfac6 with scrape type 2
2026-03-28 11:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57d6148c-6d35-533b-9614-6b7c45ebfac6, identifier: XV66825
2026-03-28 11:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57d6148c-6d35-533b-9614-6b7c45ebfac6 with identifier: XV66825
2026-03-28 11:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57d6148c-6d35-533b-9614-6b7c45ebfac6 with identifier: XV66825
2026-03-28 11:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57d6148c-6d35-533b-9614-6b7c45ebfac6 with identifier: XV66825 to the API
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:24:50Z',
 'fuel_type': 'diesel',
 'id': '57d6148c-6d35-533b-9614-6b7c45ebfac6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV66825',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 253179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-10',
 'seller_name': None,
 'title': 'BMW 5er 535d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2015}
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV66825%27 HTTP/1.1" 200 None
2026-03-28 11:14:25 [auto1.de] INFO: Saving data for XV66825: {'auction_closing_time': 1774715090.0, 'created_time': 1774380511.660144, 'last_price_update_time': 1774696465.592731}
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV66825') HTTP/1.1" 204 0
2026-03-28 11:14:25 [auto1.de] INFO: Found listing with ID: FR75488
2026-03-28 11:14:25 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-28 11:14:25 [auto1.de] INFO: Found listing with ID: VT63702
2026-03-28 11:14:25 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-28 11:14:25 [auto1.de] INFO: Scrape type for JW24568: 2
2026-03-28 11:14:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568
2026-03-28 11:14:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51564e3-9f42-597c-815a-088caf230849 with scrape type 2
2026-03-28 11:14:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c51564e3-9f42-597c-815a-088caf230849 with scrape type 2
2026-03-28 11:14:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c51564e3-9f42-597c-815a-088caf230849, identifier: JW24568
2026-03-28 11:14:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568
2026-03-28 11:14:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568
2026-03-28 11:14:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c51564e3-9f42-597c-815a-088caf230849 with identifier: JW24568 to the API
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:26:31Z',
 'fuel_type': 'petrol',
 'id': 'c51564e3-9f42-597c-815a-088caf230849',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW24568',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 111058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-18',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-28 11:14:26 [auto1.de] INFO: Saving data for JW24568: {'auction_closing_time': 1774715191.0, 'created_time': 1774608605.819046, 'last_price_update_time': 1774696466.077999}
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW24568') HTTP/1.1" 204 0
2026-03-28 11:14:26 [auto1.de] INFO: Found listing with ID: SU14933
2026-03-28 11:14:26 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-28 11:14:26 [auto1.de] INFO: Found listing with ID: RT88012
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT88012%27 HTTP/1.1" 200 None
2026-03-28 11:14:26 [auto1.de] INFO: Scrape type for RT88012: 2
2026-03-28 11:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b82cf3-9568-570f-b60b-d688c75f5a53 with identifier: RT88012
2026-03-28 11:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b82cf3-9568-570f-b60b-d688c75f5a53 with scrape type 2
2026-03-28 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b82cf3-9568-570f-b60b-d688c75f5a53 with scrape type 2
2026-03-28 11:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4b82cf3-9568-570f-b60b-d688c75f5a53, identifier: RT88012
2026-03-28 11:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4b82cf3-9568-570f-b60b-d688c75f5a53 with identifier: RT88012
2026-03-28 11:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4b82cf3-9568-570f-b60b-d688c75f5a53 with identifier: RT88012
2026-03-28 11:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4b82cf3-9568-570f-b60b-d688c75f5a53 with identifier: RT88012 to the API
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:59:14Z',
 'fuel_type': 'diesel',
 'id': 'f4b82cf3-9568-570f-b60b-d688c75f5a53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT88012',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 363475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-16',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT88012%27 HTTP/1.1" 200 None
2026-03-28 11:14:26 [auto1.de] INFO: Saving data for RT88012: {'auction_closing_time': 1774717154.0, 'created_time': 1774381184.789998, 'last_price_update_time': 1774696466.477908}
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT88012') HTTP/1.1" 204 0
2026-03-28 11:14:26 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-28 11:14:26 [auto1.de] INFO: Found listing with ID: EU73133
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU73133%27 HTTP/1.1" 200 None
2026-03-28 11:14:26 [auto1.de] INFO: Scrape type for EU73133: 2
2026-03-28 11:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with identifier: EU73133
2026-03-28 11:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with scrape type 2
2026-03-28 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with scrape type 2
2026-03-28 11:14:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4cfc360-18ec-5681-b5f7-3fc32aeeea95, identifier: EU73133
2026-03-28 11:14:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with identifier: EU73133
2026-03-28 11:14:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with identifier: EU73133
2026-03-28 11:14:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4cfc360-18ec-5681-b5f7-3fc32aeeea95 with identifier: EU73133 to the API
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:24:01Z',
 'fuel_type': 'diesel',
 'id': 'd4cfc360-18ec-5681-b5f7-3fc32aeeea95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU73133',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 364229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TDI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2016}
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU73133%27 HTTP/1.1" 200 None
2026-03-28 11:14:26 [auto1.de] INFO: Saving data for EU73133: {'auction_closing_time': 1774715041.0, 'created_time': 1774349873.51942, 'last_price_update_time': 1774696466.880838}
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU73133') HTTP/1.1" 204 0
2026-03-28 11:14:26 [auto1.de] INFO: Found listing with ID: HB31061
2026-03-28 11:14:26 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-28 11:14:26 [auto1.de] INFO: Scrape type for AN15165: 2
2026-03-28 11:14:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165
2026-03-28 11:14:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c212417-4fab-50a3-a22a-bc2614180ae0 with scrape type 2
2026-03-28 11:14:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c212417-4fab-50a3-a22a-bc2614180ae0 with scrape type 2
2026-03-28 11:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c212417-4fab-50a3-a22a-bc2614180ae0, identifier: AN15165
2026-03-28 11:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165
2026-03-28 11:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165
2026-03-28 11:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c212417-4fab-50a3-a22a-bc2614180ae0 with identifier: AN15165 to the API
2026-03-28 11:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-28T16:45:24Z',
 'fuel_type': 'hybrid',
 'id': '3c212417-4fab-50a3-a22a-bc2614180ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN15165',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 96025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-22',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2022}
2026-03-28 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-28 11:14:27 [auto1.de] INFO: Saving data for AN15165: {'auction_closing_time': 1774716324.0, 'created_time': 1774608581.029984, 'last_price_update_time': 1774696467.27683}
2026-03-28 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN15165') HTTP/1.1" 204 0
2026-03-28 11:14:27 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-28 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-28 11:14:27 [auto1.de] INFO: Scrape type for YK99785: 2
2026-03-28 11:14:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785
2026-03-28 11:14:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75fcfc91-0954-57fe-9278-05d171145ec5 with scrape type 2
2026-03-28 11:14:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75fcfc91-0954-57fe-9278-05d171145ec5 with scrape type 2
2026-03-28 11:14:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75fcfc91-0954-57fe-9278-05d171145ec5, identifier: YK99785
2026-03-28 11:14:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785
2026-03-28 11:14:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785
2026-03-28 11:14:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75fcfc91-0954-57fe-9278-05d171145ec5 with identifier: YK99785 to the API
2026-03-28 11:14:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:29:36Z',
 'fuel_type': 'petrol',
 'id': '75fcfc91-0954-57fe-9278-05d171145ec5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK99785',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 56197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-28 11:14:28 [auto1.de] INFO: Saving data for YK99785: {'auction_closing_time': 1774715376.0, 'created_time': 1773308107.320436, 'last_price_update_time': 1774696468.337103}
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK99785') HTTP/1.1" 204 0
2026-03-28 11:14:28 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-28 11:14:28 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-28 11:14:28 [auto1.de] INFO: Scrape type for EG76856: 2
2026-03-28 11:14:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856
2026-03-28 11:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with scrape type 2
2026-03-28 11:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with scrape type 2
2026-03-28 11:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06, identifier: EG76856
2026-03-28 11:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856
2026-03-28 11:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856
2026-03-28 11:14:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ed4170d-8620-5afc-8278-3fe9f4bc1f06 with identifier: EG76856 to the API
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:39:05Z',
 'fuel_type': 'petrol',
 'id': '8ed4170d-8620-5afc-8278-3fe9f4bc1f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG76856',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 114975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-13',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TSI FR 4Drive',
 'transmission': 'automatic',
 'trim': 'FR 4Drive',
 'year': 2017}
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-28 11:14:28 [auto1.de] INFO: Saving data for EG76856: {'auction_closing_time': 1774715945.0, 'created_time': 1773381186.949201, 'last_price_update_time': 1774696468.744717}
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG76856') HTTP/1.1" 204 0
2026-03-28 11:14:28 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-28 11:14:28 [auto1.de] INFO: Scrape type for FU68975: 2
2026-03-28 11:14:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975
2026-03-28 11:14:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with scrape type 2
2026-03-28 11:14:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with scrape type 2
2026-03-28 11:14:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1, identifier: FU68975
2026-03-28 11:14:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975
2026-03-28 11:14:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975
2026-03-28 11:14:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1 with identifier: FU68975 to the API
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:13:49Z',
 'fuel_type': 'diesel',
 'id': 'cf7be5f5-04ab-591b-bd29-c4d16ac3a4e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU68975',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 243868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-28 11:14:29 [auto1.de] INFO: Saving data for FU68975: {'auction_closing_time': 1774714429.0, 'created_time': 1773946014.772895, 'last_price_update_time': 1774696469.193755}
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU68975') HTTP/1.1" 204 0
2026-03-28 11:14:29 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-28 11:14:29 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-28 11:14:29 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-28 11:14:29 [auto1.de] INFO: Scrape type for VN54723: 2
2026-03-28 11:14:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723
2026-03-28 11:14:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 476b3956-3a5e-5b10-945d-c0e3d5343e6b with scrape type 2
2026-03-28 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 476b3956-3a5e-5b10-945d-c0e3d5343e6b with scrape type 2
2026-03-28 11:14:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 476b3956-3a5e-5b10-945d-c0e3d5343e6b, identifier: VN54723
2026-03-28 11:14:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723
2026-03-28 11:14:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723
2026-03-28 11:14:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 476b3956-3a5e-5b10-945d-c0e3d5343e6b with identifier: VN54723 to the API
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:35:34Z',
 'fuel_type': 'diesel',
 'id': '476b3956-3a5e-5b10-945d-c0e3d5343e6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN54723',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 60946,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-05',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L2 Multispace Selection',
 'transmission': 'automatic',
 'trim': 'L2 Multispace Selection',
 'year': 2015}
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-28 11:14:29 [auto1.de] INFO: Saving data for VN54723: {'auction_closing_time': 1774715734.0, 'created_time': 1773304582.772322, 'last_price_update_time': 1774696469.626014}
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN54723') HTTP/1.1" 204 0
2026-03-28 11:14:29 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-28 11:14:29 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-28 11:14:29 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-28 11:14:29 [auto1.de] INFO: Scrape type for RC64301: 2
2026-03-28 11:14:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301
2026-03-28 11:14:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with scrape type 2
2026-03-28 11:14:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with scrape type 2
2026-03-28 11:14:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41, identifier: RC64301
2026-03-28 11:14:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301
2026-03-28 11:14:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301
2026-03-28 11:14:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41 with identifier: RC64301 to the API
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 235,
 'expiration_date': '2026-03-28T16:10:53Z',
 'fuel_type': 'diesel',
 'id': '1d4fc9e9-81f9-51ab-a08c-84f3d6cb0f41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC64301',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 161156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-10',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-28 11:14:30 [auto1.de] INFO: Saving data for RC64301: {'auction_closing_time': 1774714253.0, 'created_time': 1773831286.755957, 'last_price_update_time': 1774696470.062061}
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC64301') HTTP/1.1" 204 0
2026-03-28 11:14:30 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-28 11:14:30 [auto1.de] INFO: Scrape type for TB14981: 2
2026-03-28 11:14:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981
2026-03-28 11:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31e77e6e-db64-5fd3-a646-138ff878c268 with scrape type 2
2026-03-28 11:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31e77e6e-db64-5fd3-a646-138ff878c268 with scrape type 2
2026-03-28 11:14:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31e77e6e-db64-5fd3-a646-138ff878c268, identifier: TB14981
2026-03-28 11:14:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981
2026-03-28 11:14:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981
2026-03-28 11:14:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31e77e6e-db64-5fd3-a646-138ff878c268 with identifier: TB14981 to the API
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:00:51Z',
 'fuel_type': 'diesel',
 'id': '31e77e6e-db64-5fd3-a646-138ff878c268',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB14981',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 265743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-15',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-28 11:14:30 [auto1.de] INFO: Saving data for TB14981: {'auction_closing_time': 1774713651.0, 'created_time': 1774608580.341538, 'last_price_update_time': 1774696470.440115}
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB14981') HTTP/1.1" 204 0
2026-03-28 11:14:30 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-28 11:14:30 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-28 11:14:30 [auto1.de] INFO: Scrape type for PA20304: 2
2026-03-28 11:14:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304
2026-03-28 11:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17c774f4-b417-59c9-80e4-a49e0620b47c with scrape type 2
2026-03-28 11:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17c774f4-b417-59c9-80e4-a49e0620b47c with scrape type 2
2026-03-28 11:14:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17c774f4-b417-59c9-80e4-a49e0620b47c, identifier: PA20304
2026-03-28 11:14:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304
2026-03-28 11:14:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304
2026-03-28 11:14:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17c774f4-b417-59c9-80e4-a49e0620b47c with identifier: PA20304 to the API
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:32:30Z',
 'fuel_type': 'diesel',
 'id': '17c774f4-b417-59c9-80e4-a49e0620b47c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA20304',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 91106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-29',
 'seller_name': None,
 'title': 'Hyundai ix35 1.7 CRDi FIFA World Cup Edition 2WD',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition 2WD',
 'year': 2014}
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-28 11:14:30 [auto1.de] INFO: Saving data for PA20304: {'auction_closing_time': 1774715550.0, 'created_time': 1774350283.299845, 'last_price_update_time': 1774696470.939831}
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA20304') HTTP/1.1" 204 0
2026-03-28 11:14:30 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-28 11:14:30 [auto1.de] INFO: Scrape type for EE00996: 2
2026-03-28 11:14:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996
2026-03-28 11:14:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with scrape type 2
2026-03-28 11:14:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with scrape type 2
2026-03-28 11:14:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc, identifier: EE00996
2026-03-28 11:14:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996
2026-03-28 11:14:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996
2026-03-28 11:14:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29a91ab9-2670-5ef0-baa3-cfd18d76a1dc with identifier: EE00996 to the API
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:53:42Z',
 'fuel_type': 'diesel',
 'id': '29a91ab9-2670-5ef0-baa3-cfd18d76a1dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE00996',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XE',
 'odometer': 156194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-21',
 'seller_name': None,
 'title': 'Jaguar XE 20d Prestige',
 'transmission': 'automatic',
 'trim': 'Prestige',
 'year': 2015}
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-28 11:14:31 [auto1.de] INFO: Saving data for EE00996: {'auction_closing_time': 1774716822.0, 'created_time': 1773225737.530438, 'last_price_update_time': 1774696471.684328}
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE00996') HTTP/1.1" 204 0
2026-03-28 11:14:31 [auto1.de] INFO: Found listing with ID: NP68778
2026-03-28 11:14:31 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-28 11:14:31 [auto1.de] INFO: Scrape type for VJ29661: 2
2026-03-28 11:14:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661
2026-03-28 11:14:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36dccb9f-bede-593e-a7e5-6d4749ac3052 with scrape type 2
2026-03-28 11:14:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36dccb9f-bede-593e-a7e5-6d4749ac3052 with scrape type 2
2026-03-28 11:14:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36dccb9f-bede-593e-a7e5-6d4749ac3052, identifier: VJ29661
2026-03-28 11:14:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661
2026-03-28 11:14:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661
2026-03-28 11:14:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36dccb9f-bede-593e-a7e5-6d4749ac3052 with identifier: VJ29661 to the API
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:25:58Z',
 'fuel_type': 'petrol',
 'id': '36dccb9f-bede-593e-a7e5-6d4749ac3052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ29661',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 54306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-15',
 'seller_name': None,
 'title': 'Citroen C4 1.6 VTi VTR Plus',
 'transmission': 'automatic',
 'trim': 'VTR Plus',
 'year': 2009}
2026-03-28 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-28 11:14:32 [auto1.de] INFO: Saving data for VJ29661: {'auction_closing_time': 1774715158.0, 'created_time': 1774608574.469571, 'last_price_update_time': 1774696472.115372}
2026-03-28 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ29661') HTTP/1.1" 204 0
2026-03-28 11:14:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:14:39 [auto1.de] INFO: Channel: 24h | Page: 240 | totalHits: 9715 | hits on page: 40
2026-03-28 11:14:39 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-28 11:14:39 [auto1.de] INFO: Scrape type for SX40224: 2
2026-03-28 11:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224
2026-03-28 11:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd814f5c-6156-58a7-86fd-c1e606c64ac9 with scrape type 2
2026-03-28 11:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd814f5c-6156-58a7-86fd-c1e606c64ac9 with scrape type 2
2026-03-28 11:14:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd814f5c-6156-58a7-86fd-c1e606c64ac9, identifier: SX40224
2026-03-28 11:14:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224
2026-03-28 11:14:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224
2026-03-28 11:14:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd814f5c-6156-58a7-86fd-c1e606c64ac9 with identifier: SX40224 to the API
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:02:59Z',
 'fuel_type': 'petrol',
 'id': 'fd814f5c-6156-58a7-86fd-c1e606c64ac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX40224',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 47453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-24',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2017}
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-28 11:14:39 [auto1.de] INFO: Saving data for SX40224: {'auction_closing_time': 1774713779.0, 'created_time': 1773303355.25174, 'last_price_update_time': 1774696479.960113}
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX40224') HTTP/1.1" 204 0
2026-03-28 11:14:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:14:39 [auto1.de] INFO: Found listing with ID: XS17240
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS17240%27 HTTP/1.1" 200 None
2026-03-28 11:14:39 [auto1.de] INFO: Scrape type for XS17240: 2
2026-03-28 11:14:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5860693d-9dc9-54b0-8435-c0fecdb95f12 with identifier: XS17240
2026-03-28 11:14:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5860693d-9dc9-54b0-8435-c0fecdb95f12 with scrape type 2
2026-03-28 11:14:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5860693d-9dc9-54b0-8435-c0fecdb95f12 with scrape type 2
2026-03-28 11:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5860693d-9dc9-54b0-8435-c0fecdb95f12, identifier: XS17240
2026-03-28 11:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5860693d-9dc9-54b0-8435-c0fecdb95f12 with identifier: XS17240
2026-03-28 11:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5860693d-9dc9-54b0-8435-c0fecdb95f12 with identifier: XS17240
2026-03-28 11:14:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5860693d-9dc9-54b0-8435-c0fecdb95f12 with identifier: XS17240 to the API
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:49:12Z',
 'fuel_type': 'petrol',
 'id': '5860693d-9dc9-54b0-8435-c0fecdb95f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS17240',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 156557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-31',
 'seller_name': None,
 'title': 'Ford Focus 1.8 White Magic',
 'transmission': 'manual',
 'trim': 'White Magic',
 'year': 2010}
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS17240%27 HTTP/1.1" 200 None
2026-03-28 11:14:40 [auto1.de] INFO: Saving data for XS17240: {'auction_closing_time': 1774716552.0, 'created_time': 1773228264.113777, 'last_price_update_time': 1774696480.363205}
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS17240') HTTP/1.1" 204 0
2026-03-28 11:14:40 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-28 11:14:40 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-28 11:14:40 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-28 11:14:40 [auto1.de] INFO: Scrape type for EK35927: 2
2026-03-28 11:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927
2026-03-28 11:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with scrape type 2
2026-03-28 11:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with scrape type 2
2026-03-28 11:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5, identifier: EK35927
2026-03-28 11:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927
2026-03-28 11:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927
2026-03-28 11:14:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88f5dc3d-7c0f-5c73-b99d-0c418ac358e5 with identifier: EK35927 to the API
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:13:00Z',
 'fuel_type': 'petrol',
 'id': '88f5dc3d-7c0f-5c73-b99d-0c418ac358e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK35927',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 139354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-18',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Best of',
 'transmission': 'manual',
 'trim': 'Best of',
 'year': 2008}
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-28 11:14:40 [auto1.de] INFO: Saving data for EK35927: {'auction_closing_time': 1774714380.0, 'created_time': 1774608612.503727, 'last_price_update_time': 1774696480.767312}
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK35927') HTTP/1.1" 204 0
2026-03-28 11:14:40 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-28 11:14:40 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-28 11:14:40 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-28 11:14:40 [auto1.de] INFO: Scrape type for NV35825: 2
2026-03-28 11:14:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825
2026-03-28 11:14:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with scrape type 2
2026-03-28 11:14:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with scrape type 2
2026-03-28 11:14:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0, identifier: NV35825
2026-03-28 11:14:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825
2026-03-28 11:14:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825
2026-03-28 11:14:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a0f9732-f4a7-5a17-a2d0-4ab1561931e0 with identifier: NV35825 to the API
2026-03-28 11:14:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:15:51Z',
 'fuel_type': 'diesel',
 'id': '5a0f9732-f4a7-5a17-a2d0-4ab1561931e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV35825',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 58701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-17',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2019}
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-28 11:14:41 [auto1.de] INFO: Saving data for NV35825: {'auction_closing_time': 1774714551.0, 'created_time': 1774608606.832805, 'last_price_update_time': 1774696481.156773}
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV35825') HTTP/1.1" 204 0
2026-03-28 11:14:41 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-28 11:14:41 [auto1.de] INFO: Scrape type for GB27132: 2
2026-03-28 11:14:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132
2026-03-28 11:14:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08fbb12-8df3-56bc-8412-a06904636da1 with scrape type 2
2026-03-28 11:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08fbb12-8df3-56bc-8412-a06904636da1 with scrape type 2
2026-03-28 11:14:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f08fbb12-8df3-56bc-8412-a06904636da1, identifier: GB27132
2026-03-28 11:14:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132
2026-03-28 11:14:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132
2026-03-28 11:14:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f08fbb12-8df3-56bc-8412-a06904636da1 with identifier: GB27132 to the API
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:36:34Z',
 'fuel_type': 'petrol',
 'id': 'f08fbb12-8df3-56bc-8412-a06904636da1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB27132',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 67639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-02',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2019}
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-28 11:14:41 [auto1.de] INFO: Saving data for GB27132: {'auction_closing_time': 1774715794.0, 'created_time': 1773302926.630431, 'last_price_update_time': 1774696481.664165}
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB27132') HTTP/1.1" 204 0
2026-03-28 11:14:41 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-28 11:14:41 [auto1.de] INFO: Scrape type for SR34905: 2
2026-03-28 11:14:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905
2026-03-28 11:14:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f63e23b5-1882-5871-b246-011db2b0e393 with scrape type 2
2026-03-28 11:14:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f63e23b5-1882-5871-b246-011db2b0e393 with scrape type 2
2026-03-28 11:14:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f63e23b5-1882-5871-b246-011db2b0e393, identifier: SR34905
2026-03-28 11:14:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2026-03-28 11:14:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:14:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:14:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905
2026-03-28 11:14:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f63e23b5-1882-5871-b246-011db2b0e393 with identifier: SR34905 to the API
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'purple',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:04:16Z',
 'fuel_type': 'diesel',
 'id': 'f63e23b5-1882-5871-b246-011db2b0e393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR34905',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 263024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-08',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.7 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-28 11:14:42 [auto1.de] INFO: Saving data for SR34905: {'auction_closing_time': 1774713856.0, 'created_time': 1773306502.164623, 'last_price_update_time': 1774696482.225336}
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR34905') HTTP/1.1" 204 0
2026-03-28 11:14:42 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-28 11:14:42 [auto1.de] INFO: Scrape type for BN62296: 2
2026-03-28 11:14:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296
2026-03-28 11:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b63c329-caa3-547b-975b-76f770a4a703 with scrape type 2
2026-03-28 11:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b63c329-caa3-547b-975b-76f770a4a703 with scrape type 2
2026-03-28 11:14:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b63c329-caa3-547b-975b-76f770a4a703, identifier: BN62296
2026-03-28 11:14:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296
2026-03-28 11:14:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296
2026-03-28 11:14:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b63c329-caa3-547b-975b-76f770a4a703 with identifier: BN62296 to the API
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-28T16:45:04Z',
 'fuel_type': 'petrol',
 'id': '1b63c329-caa3-547b-975b-76f770a4a703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN62296',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 80783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-12',
 'seller_name': None,
 'title': 'MINI Clubman John Cooper Works ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2022}
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-28 11:14:42 [auto1.de] INFO: Saving data for BN62296: {'auction_closing_time': 1774716304.0, 'created_time': 1774608604.307859, 'last_price_update_time': 1774696482.610619}
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN62296') HTTP/1.1" 204 0
2026-03-28 11:14:42 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-28 11:14:42 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-28 11:14:42 [auto1.de] INFO: Scrape type for AJ78717: 2
2026-03-28 11:14:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717
2026-03-28 11:14:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b507cde-33b3-5619-ba75-c9ec008a6871 with scrape type 2
2026-03-28 11:14:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b507cde-33b3-5619-ba75-c9ec008a6871 with scrape type 2
2026-03-28 11:14:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b507cde-33b3-5619-ba75-c9ec008a6871, identifier: AJ78717
2026-03-28 11:14:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717
2026-03-28 11:14:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717
2026-03-28 11:14:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b507cde-33b3-5619-ba75-c9ec008a6871 with identifier: AJ78717 to the API
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:39:10Z',
 'fuel_type': 'petrol',
 'id': '7b507cde-33b3-5619-ba75-c9ec008a6871',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ78717',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 214777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI ACT S line Sportpaket ultra',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket ultra',
 'year': 2016}
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-28 11:14:43 [auto1.de] INFO: Saving data for AJ78717: {'auction_closing_time': 1774715950.0, 'created_time': 1773831157.482878, 'last_price_update_time': 1774696483.011514}
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ78717') HTTP/1.1" 204 0
2026-03-28 11:14:43 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-28 11:14:43 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-28 11:14:43 [auto1.de] INFO: Scrape type for GN45872: 2
2026-03-28 11:14:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872
2026-03-28 11:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19e056ce-3716-5bdb-8648-4146a7792edd with scrape type 2
2026-03-28 11:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19e056ce-3716-5bdb-8648-4146a7792edd with scrape type 2
2026-03-28 11:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19e056ce-3716-5bdb-8648-4146a7792edd, identifier: GN45872
2026-03-28 11:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872
2026-03-28 11:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872
2026-03-28 11:14:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19e056ce-3716-5bdb-8648-4146a7792edd with identifier: GN45872 to the API
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:05Z',
 'fuel_type': 'petrol',
 'id': '19e056ce-3716-5bdb-8648-4146a7792edd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN45872',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 53136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-01',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-28 11:14:43 [auto1.de] INFO: Saving data for GN45872: {'auction_closing_time': 1774714385.0, 'created_time': 1774293983.015387, 'last_price_update_time': 1774696483.411412}
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN45872') HTTP/1.1" 204 0
2026-03-28 11:14:43 [auto1.de] INFO: Found listing with ID: NS35673
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35673%27 HTTP/1.1" 200 None
2026-03-28 11:14:43 [auto1.de] INFO: Scrape type for NS35673: 2
2026-03-28 11:14:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with identifier: NS35673
2026-03-28 11:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with scrape type 2
2026-03-28 11:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with scrape type 2
2026-03-28 11:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9accb1a7-ed74-52ab-adc1-480dd60d15d2, identifier: NS35673
2026-03-28 11:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with identifier: NS35673
2026-03-28 11:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with identifier: NS35673
2026-03-28 11:14:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9accb1a7-ed74-52ab-adc1-480dd60d15d2 with identifier: NS35673 to the API
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:26:57Z',
 'fuel_type': 'diesel',
 'id': '9accb1a7-ed74-52ab-adc1-480dd60d15d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS35673',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 244766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-04',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2012}
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35673%27 HTTP/1.1" 200 None
2026-03-28 11:14:43 [auto1.de] INFO: Saving data for NS35673: {'auction_closing_time': 1774715217.0, 'created_time': 1774350967.889293, 'last_price_update_time': 1774696483.801842}
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS35673') HTTP/1.1" 204 0
2026-03-28 11:14:43 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-28 11:14:43 [auto1.de] INFO: Scrape type for FW84065: 2
2026-03-28 11:14:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065
2026-03-28 11:14:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e003a27-8c1c-51cb-b27b-70faf71aabeb with scrape type 2
2026-03-28 11:14:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e003a27-8c1c-51cb-b27b-70faf71aabeb with scrape type 2
2026-03-28 11:14:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e003a27-8c1c-51cb-b27b-70faf71aabeb, identifier: FW84065
2026-03-28 11:14:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065
2026-03-28 11:14:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065
2026-03-28 11:14:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e003a27-8c1c-51cb-b27b-70faf71aabeb with identifier: FW84065 to the API
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:16:16Z',
 'fuel_type': 'diesel',
 'id': '4e003a27-8c1c-51cb-b27b-70faf71aabeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW84065',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C-Crosser',
 'odometer': 195626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-04',
 'seller_name': None,
 'title': 'Citroen C-Crosser 2.2 HDi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-28 11:14:44 [auto1.de] INFO: Saving data for FW84065: {'auction_closing_time': 1774714576.0, 'created_time': 1773946450.424906, 'last_price_update_time': 1774696484.179763}
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW84065') HTTP/1.1" 204 0
2026-03-28 11:14:44 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-28 11:14:44 [auto1.de] INFO: Scrape type for BP24575: 2
2026-03-28 11:14:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575
2026-03-28 11:14:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with scrape type 2
2026-03-28 11:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with scrape type 2
2026-03-28 11:14:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d, identifier: BP24575
2026-03-28 11:14:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:14:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575
2026-03-28 11:14:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575
2026-03-28 11:14:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3f1334e-fde6-59cd-b2cc-f9f257cfa26d with identifier: BP24575 to the API
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:30:04Z',
 'fuel_type': 'diesel',
 'id': 'c3f1334e-fde6-59cd-b2cc-f9f257cfa26d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP24575',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 176105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-02',
 'seller_name': None,
 'title': 'MINI Countryman Cooper D ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2015}
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-28 11:14:44 [auto1.de] INFO: Saving data for BP24575: {'auction_closing_time': 1774715404.0, 'created_time': 1774608611.421232, 'last_price_update_time': 1774696484.574963}
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP24575') HTTP/1.1" 204 0
2026-03-28 11:14:44 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-28 11:14:44 [auto1.de] INFO: Scrape type for JA25299: 2
2026-03-28 11:14:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299
2026-03-28 11:14:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with scrape type 2
2026-03-28 11:14:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with scrape type 2
2026-03-28 11:14:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132, identifier: JA25299
2026-03-28 11:14:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299
2026-03-28 11:14:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299
2026-03-28 11:14:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7db8dd64-8d7e-5bc4-ab81-7a4f73128132 with identifier: JA25299 to the API
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:57:18Z',
 'fuel_type': 'petrol',
 'id': '7db8dd64-8d7e-5bc4-ab81-7a4f73128132',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA25299',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 36660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-06',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2021}
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-28 11:14:44 [auto1.de] INFO: Saving data for JA25299: {'auction_closing_time': 1774717038.0, 'created_time': 1773383012.053168, 'last_price_update_time': 1774696484.985542}
2026-03-28 11:14:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA25299') HTTP/1.1" 204 0
2026-03-28 11:14:45 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-28 11:14:45 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-28 11:14:45 [auto1.de] INFO: Scrape type for VH71903: 2
2026-03-28 11:14:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903
2026-03-28 11:14:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4be3bbd5-ae53-5068-86f9-87028fff9951 with scrape type 2
2026-03-28 11:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4be3bbd5-ae53-5068-86f9-87028fff9951 with scrape type 2
2026-03-28 11:14:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4be3bbd5-ae53-5068-86f9-87028fff9951, identifier: VH71903
2026-03-28 11:14:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903
2026-03-28 11:14:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903
2026-03-28 11:14:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4be3bbd5-ae53-5068-86f9-87028fff9951 with identifier: VH71903 to the API
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:04:48Z',
 'fuel_type': 'diesel',
 'id': '4be3bbd5-ae53-5068-86f9-87028fff9951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH71903',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 197821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-16',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-28 11:14:45 [auto1.de] INFO: Saving data for VH71903: {'auction_closing_time': 1774713888.0, 'created_time': 1773306884.353655, 'last_price_update_time': 1774696485.502893}
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH71903') HTTP/1.1" 204 0
2026-03-28 11:14:45 [auto1.de] INFO: Channel: 24h | Page: 241 | totalHits: 9715 | hits on page: 40
2026-03-28 11:14:45 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-28 11:14:45 [auto1.de] INFO: Found listing with ID: GD02806
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02806%27 HTTP/1.1" 200 None
2026-03-28 11:14:45 [auto1.de] INFO: Scrape type for GD02806: 2
2026-03-28 11:14:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e24433-cdb7-5712-89ca-b4f94b858d9c with identifier: GD02806
2026-03-28 11:14:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e24433-cdb7-5712-89ca-b4f94b858d9c with scrape type 2
2026-03-28 11:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9e24433-cdb7-5712-89ca-b4f94b858d9c with scrape type 2
2026-03-28 11:14:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9e24433-cdb7-5712-89ca-b4f94b858d9c, identifier: GD02806
2026-03-28 11:14:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9e24433-cdb7-5712-89ca-b4f94b858d9c with identifier: GD02806
2026-03-28 11:14:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9e24433-cdb7-5712-89ca-b4f94b858d9c with identifier: GD02806
2026-03-28 11:14:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9e24433-cdb7-5712-89ca-b4f94b858d9c with identifier: GD02806 to the API
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:33Z',
 'fuel_type': 'petrol',
 'id': 'c9e24433-cdb7-5712-89ca-b4f94b858d9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD02806',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 216912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-04',
 'seller_name': None,
 'title': 'Kia Rio 1.6 EX Top',
 'transmission': 'automatic',
 'trim': 'EX Top',
 'year': 2006}
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD02806%27 HTTP/1.1" 200 None
2026-03-28 11:14:45 [auto1.de] INFO: Saving data for GD02806: {'auction_closing_time': 1774714533.0, 'created_time': 1773307109.445441, 'last_price_update_time': 1774696485.926123}
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD02806') HTTP/1.1" 204 0
2026-03-28 11:14:45 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-28 11:14:45 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-28 11:14:45 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-28 11:14:45 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-28 11:14:45 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-28 11:14:45 [auto1.de] INFO: Scrape type for YS72291: 2
2026-03-28 11:14:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291
2026-03-28 11:14:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with scrape type 2
2026-03-28 11:14:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with scrape type 2
2026-03-28 11:14:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afcd1e36-5f40-5674-bdb0-78a09c64f7c4, identifier: YS72291
2026-03-28 11:14:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:14:46 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-28 11:14:46 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-28 11:14:46 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-28 11:14:46 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-28 11:14:46 [auto1.de] INFO: Scrape type for DN13458: 2
2026-03-28 11:14:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458
2026-03-28 11:14:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 658e31ff-5926-5c1e-878e-d24a5d33b43d with scrape type 2
2026-03-28 11:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 658e31ff-5926-5c1e-878e-d24a5d33b43d with scrape type 2
2026-03-28 11:14:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 658e31ff-5926-5c1e-878e-d24a5d33b43d, identifier: DN13458
2026-03-28 11:14:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291
2026-03-28 11:14:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291
2026-03-28 11:14:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afcd1e36-5f40-5674-bdb0-78a09c64f7c4 with identifier: YS72291 to the API
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:22:33Z',
 'fuel_type': 'diesel',
 'id': 'afcd1e36-5f40-5674-bdb0-78a09c64f7c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS72291',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 91799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-20',
 'seller_name': None,
 'title': 'Seat Arona 1.6 TDI Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2018}
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-28 11:14:46 [auto1.de] INFO: Saving data for YS72291: {'auction_closing_time': 1774714953.0, 'created_time': 1773226157.857367, 'last_price_update_time': 1774696486.523002}
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS72291') HTTP/1.1" 204 0
2026-03-28 11:14:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458
2026-03-28 11:14:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458
2026-03-28 11:14:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 658e31ff-5926-5c1e-878e-d24a5d33b43d with identifier: DN13458 to the API
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:22:38Z',
 'fuel_type': 'petrol',
 'id': '658e31ff-5926-5c1e-878e-d24a5d33b43d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN13458',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 174340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-29',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Tour Edition',
 'transmission': 'manual',
 'trim': 'Tour Edition',
 'year': 2007}
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-28 11:14:46 [auto1.de] INFO: Saving data for DN13458: {'auction_closing_time': 1774714958.0, 'created_time': 1774608590.887549, 'last_price_update_time': 1774696486.912904}
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN13458') HTTP/1.1" 204 0
2026-03-28 11:14:46 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-28 11:14:46 [auto1.de] INFO: Scrape type for NU40384: 2
2026-03-28 11:14:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384
2026-03-28 11:14:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2508733c-c736-5841-bf1b-aecfddd1804b with scrape type 2
2026-03-28 11:14:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2508733c-c736-5841-bf1b-aecfddd1804b with scrape type 2
2026-03-28 11:14:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2508733c-c736-5841-bf1b-aecfddd1804b, identifier: NU40384
2026-03-28 11:14:47 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-28 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-28 11:14:47 [auto1.de] INFO: Scrape type for YV03143: 2
2026-03-28 11:14:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143
2026-03-28 11:14:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95497ab5-d796-5a75-b63c-adc9989dba64 with scrape type 2
2026-03-28 11:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95497ab5-d796-5a75-b63c-adc9989dba64 with scrape type 2
2026-03-28 11:14:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95497ab5-d796-5a75-b63c-adc9989dba64, identifier: YV03143
2026-03-28 11:14:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384
2026-03-28 11:14:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384
2026-03-28 11:14:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2508733c-c736-5841-bf1b-aecfddd1804b with identifier: NU40384 to the API
2026-03-28 11:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:21:58Z',
 'fuel_type': 'diesel',
 'id': '2508733c-c736-5841-bf1b-aecfddd1804b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU40384',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 214090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-28 11:14:47 [auto1.de] INFO: Saving data for NU40384: {'auction_closing_time': 1774714918.0, 'created_time': 1773132508.486764, 'last_price_update_time': 1774696487.459761}
2026-03-28 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NU40384') HTTP/1.1" 204 0
2026-03-28 11:14:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143
2026-03-28 11:14:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143
2026-03-28 11:14:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95497ab5-d796-5a75-b63c-adc9989dba64 with identifier: YV03143 to the API
2026-03-28 11:14:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-28T16:51:28Z',
 'fuel_type': 'diesel',
 'id': '95497ab5-d796-5a75-b63c-adc9989dba64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV03143',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 81188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-23',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 400 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-28 11:14:48 [auto1.de] INFO: Saving data for YV03143: {'auction_closing_time': 1774716688.0, 'created_time': 1773302118.407971, 'last_price_update_time': 1774696488.360785}
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV03143') HTTP/1.1" 204 0
2026-03-28 11:14:48 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-28 11:14:48 [auto1.de] INFO: Scrape type for SU61840: 2
2026-03-28 11:14:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840
2026-03-28 11:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d29eef2-1aad-5d60-81dd-311508dc3855 with scrape type 2
2026-03-28 11:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d29eef2-1aad-5d60-81dd-311508dc3855 with scrape type 2
2026-03-28 11:14:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d29eef2-1aad-5d60-81dd-311508dc3855, identifier: SU61840
2026-03-28 11:14:48 [auto1.de] INFO: Found listing with ID: UR56671
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR56671%27 HTTP/1.1" 200 None
2026-03-28 11:14:48 [auto1.de] INFO: Scrape type for UR56671: 2
2026-03-28 11:14:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 565e9f4a-3958-5cfb-9584-f9498047c744 with identifier: UR56671
2026-03-28 11:14:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 565e9f4a-3958-5cfb-9584-f9498047c744 with scrape type 2
2026-03-28 11:14:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 565e9f4a-3958-5cfb-9584-f9498047c744 with scrape type 2
2026-03-28 11:14:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 565e9f4a-3958-5cfb-9584-f9498047c744, identifier: UR56671
2026-03-28 11:14:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840
2026-03-28 11:14:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840
2026-03-28 11:14:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d29eef2-1aad-5d60-81dd-311508dc3855 with identifier: SU61840 to the API
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:34:22Z',
 'fuel_type': 'petrol',
 'id': '3d29eef2-1aad-5d60-81dd-311508dc3855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU61840',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 49133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-07',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-28 11:14:48 [auto1.de] INFO: Saving data for SU61840: {'auction_closing_time': 1774715662.0, 'created_time': 1774608696.133629, 'last_price_update_time': 1774696488.864016}
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU61840') HTTP/1.1" 204 0
2026-03-28 11:14:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 565e9f4a-3958-5cfb-9584-f9498047c744 with identifier: UR56671
2026-03-28 11:14:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 565e9f4a-3958-5cfb-9584-f9498047c744 with identifier: UR56671
2026-03-28 11:14:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 565e9f4a-3958-5cfb-9584-f9498047c744 with identifier: UR56671 to the API
2026-03-28 11:14:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:43:57Z',
 'fuel_type': 'diesel',
 'id': '565e9f4a-3958-5cfb-9584-f9498047c744',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR56671',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 99529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-27',
 'seller_name': None,
 'title': 'Nissan X-Trail 2.2 dCi Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2005}
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR56671%27 HTTP/1.1" 200 None
2026-03-28 11:14:49 [auto1.de] INFO: Saving data for UR56671: {'auction_closing_time': 1774716237.0, 'created_time': 1774608583.712453, 'last_price_update_time': 1774696489.167114}
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR56671') HTTP/1.1" 204 0
2026-03-28 11:14:49 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-28 11:14:49 [auto1.de] INFO: Scrape type for FD22353: 2
2026-03-28 11:14:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353
2026-03-28 11:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c535e8c-19b9-514e-b8dc-66192d92671e with scrape type 2
2026-03-28 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c535e8c-19b9-514e-b8dc-66192d92671e with scrape type 2
2026-03-28 11:14:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c535e8c-19b9-514e-b8dc-66192d92671e, identifier: FD22353
2026-03-28 11:14:49 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-28 11:14:49 [auto1.de] INFO: Scrape type for GY83216: 2
2026-03-28 11:14:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216
2026-03-28 11:14:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 334798d0-b753-539d-a913-692ee571232b with scrape type 2
2026-03-28 11:14:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 334798d0-b753-539d-a913-692ee571232b with scrape type 2
2026-03-28 11:14:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 334798d0-b753-539d-a913-692ee571232b, identifier: GY83216
2026-03-28 11:14:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353
2026-03-28 11:14:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353
2026-03-28 11:14:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c535e8c-19b9-514e-b8dc-66192d92671e with identifier: FD22353 to the API
2026-03-28 11:14:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:25:17Z',
 'fuel_type': 'petrol',
 'id': '2c535e8c-19b9-514e-b8dc-66192d92671e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD22353',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 92812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-28 11:14:50 [auto1.de] INFO: Saving data for FD22353: {'auction_closing_time': 1774715117.0, 'created_time': 1774608681.637625, 'last_price_update_time': 1774696490.350539}
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD22353') HTTP/1.1" 204 0
2026-03-28 11:14:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216
2026-03-28 11:14:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216
2026-03-28 11:14:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 334798d0-b753-539d-a913-692ee571232b with identifier: GY83216 to the API
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:06:29Z',
 'fuel_type': 'diesel',
 'id': '334798d0-b753-539d-a913-692ee571232b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY83216',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 34078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-18',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 M-Jet L2H2 RS: 3450 mm',
 'transmission': 'manual',
 'trim': 'L2H2 RS: 3450 mm',
 'year': 2023}
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-28 11:14:50 [auto1.de] INFO: Saving data for GY83216: {'auction_closing_time': 1774713989.0, 'created_time': 1774608715.265914, 'last_price_update_time': 1774696490.631111}
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY83216') HTTP/1.1" 204 0
2026-03-28 11:14:50 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-28 11:14:50 [auto1.de] INFO: Scrape type for WZ92700: 2
2026-03-28 11:14:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700
2026-03-28 11:14:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with scrape type 2
2026-03-28 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with scrape type 2
2026-03-28 11:14:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d, identifier: WZ92700
2026-03-28 11:14:50 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-28 11:14:50 [auto1.de] INFO: Scrape type for DB09023: 2
2026-03-28 11:14:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023
2026-03-28 11:14:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57346407-60b7-5b98-a189-9b9f67b88ff2 with scrape type 2
2026-03-28 11:14:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57346407-60b7-5b98-a189-9b9f67b88ff2 with scrape type 2
2026-03-28 11:14:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57346407-60b7-5b98-a189-9b9f67b88ff2, identifier: DB09023
2026-03-28 11:14:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700
2026-03-28 11:14:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700
2026-03-28 11:14:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a0b7c11-2db7-5c80-8844-a0215f1ea09d with identifier: WZ92700 to the API
2026-03-28 11:14:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:55:10Z',
 'fuel_type': 'petrol',
 'id': '9a0b7c11-2db7-5c80-8844-a0215f1ea09d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ92700',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 149302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI Sport 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport 4Motion',
 'year': 2018}
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-28 11:14:51 [auto1.de] INFO: Saving data for WZ92700: {'auction_closing_time': 1774716910.0, 'created_time': 1773131998.002393, 'last_price_update_time': 1774696491.172311}
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ92700') HTTP/1.1" 204 0
2026-03-28 11:14:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023
2026-03-28 11:14:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023
2026-03-28 11:14:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57346407-60b7-5b98-a189-9b9f67b88ff2 with identifier: DB09023 to the API
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:46:39Z',
 'fuel_type': 'petrol',
 'id': '57346407-60b7-5b98-a189-9b9f67b88ff2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB09023',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 128234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-09',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-28 11:14:51 [auto1.de] INFO: Saving data for DB09023: {'auction_closing_time': 1774716399.0, 'created_time': 1774608600.462799, 'last_price_update_time': 1774696491.478541}
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB09023') HTTP/1.1" 204 0
2026-03-28 11:14:51 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-28 11:14:51 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-28 11:14:51 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-28 11:14:51 [auto1.de] INFO: Scrape type for XY63966: 2
2026-03-28 11:14:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966
2026-03-28 11:14:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6b974a3-1396-528e-8784-73a9c50fee01 with scrape type 2
2026-03-28 11:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6b974a3-1396-528e-8784-73a9c50fee01 with scrape type 2
2026-03-28 11:14:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6b974a3-1396-528e-8784-73a9c50fee01, identifier: XY63966
2026-03-28 11:14:51 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-28 11:14:51 [auto1.de] INFO: Scrape type for GA20411: 2
2026-03-28 11:14:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411
2026-03-28 11:14:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46284532-db18-5b34-8a18-4bdf04d8994b with scrape type 2
2026-03-28 11:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46284532-db18-5b34-8a18-4bdf04d8994b with scrape type 2
2026-03-28 11:14:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46284532-db18-5b34-8a18-4bdf04d8994b, identifier: GA20411
2026-03-28 11:14:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966
2026-03-28 11:14:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966
2026-03-28 11:14:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6b974a3-1396-528e-8784-73a9c50fee01 with identifier: XY63966 to the API
2026-03-28 11:14:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:26Z',
 'fuel_type': 'petrol',
 'id': 'd6b974a3-1396-528e-8784-73a9c50fee01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY63966',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 115376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Xcellence',
 'transmission': 'automatic',
 'trim': 'Xcellence',
 'year': 2018}
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-28 11:14:52 [auto1.de] INFO: Saving data for XY63966: {'auction_closing_time': 1774713986.0, 'created_time': 1774608630.410285, 'last_price_update_time': 1774696492.361207}
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY63966') HTTP/1.1" 204 0
2026-03-28 11:14:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411
2026-03-28 11:14:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411
2026-03-28 11:14:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46284532-db18-5b34-8a18-4bdf04d8994b with identifier: GA20411 to the API
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-28T16:18:23Z',
 'fuel_type': 'diesel',
 'id': '46284532-db18-5b34-8a18-4bdf04d8994b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA20411',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 120718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-01',
 'seller_name': None,
 'title': 'Jaguar XF 30d S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2018}
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-28 11:14:52 [auto1.de] INFO: Saving data for GA20411: {'auction_closing_time': 1774714703.0, 'created_time': 1773344437.804729, 'last_price_update_time': 1774696492.753813}
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA20411') HTTP/1.1" 204 0
2026-03-28 11:14:52 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-28 11:14:52 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-28 11:14:52 [auto1.de] INFO: Scrape type for FZ45055: 2
2026-03-28 11:14:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055
2026-03-28 11:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with scrape type 2
2026-03-28 11:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with scrape type 2
2026-03-28 11:14:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fef3f42b-d660-505b-abd0-a09fd8ac0fd0, identifier: FZ45055
2026-03-28 11:14:52 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-28 11:14:52 [auto1.de] INFO: Scrape type for VU07666: 2
2026-03-28 11:14:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666
2026-03-28 11:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3827f639-5d5e-5139-b41b-3c23f81f2347 with scrape type 2
2026-03-28 11:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3827f639-5d5e-5139-b41b-3c23f81f2347 with scrape type 2
2026-03-28 11:14:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3827f639-5d5e-5139-b41b-3c23f81f2347, identifier: VU07666
2026-03-28 11:14:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055
2026-03-28 11:14:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055
2026-03-28 11:14:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fef3f42b-d660-505b-abd0-a09fd8ac0fd0 with identifier: FZ45055 to the API
2026-03-28 11:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-28T16:01:49Z',
 'fuel_type': 'diesel',
 'id': 'fef3f42b-d660-505b-abd0-a09fd8ac0fd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ45055',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Scala',
 'odometer': 132822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seller_name': None,
 'title': 'Skoda Scala 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2020}
2026-03-28 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-28 11:14:53 [auto1.de] INFO: Saving data for FZ45055: {'auction_closing_time': 1774713709.0, 'created_time': 1773992658.24959, 'last_price_update_time': 1774696493.266301}
2026-03-28 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ45055') HTTP/1.1" 204 0
2026-03-28 11:14:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666
2026-03-28 11:14:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666
2026-03-28 11:14:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3827f639-5d5e-5139-b41b-3c23f81f2347 with identifier: VU07666 to the API
2026-03-28 11:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 91,
 'expiration_date': '2026-03-28T16:23:47Z',
 'fuel_type': 'petrol',
 'id': '3827f639-5d5e-5139-b41b-3c23f81f2347',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU07666',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 24791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-24',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Comfort',
 'transmission': 'automatic',
 'trim': 'Stepway Comfort',
 'year': 2021}
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-28 11:14:54 [auto1.de] INFO: Saving data for VU07666: {'auction_closing_time': 1774715027.0, 'created_time': 1773946057.757767, 'last_price_update_time': 1774696494.364799}
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU07666') HTTP/1.1" 204 0
2026-03-28 11:14:54 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-28 11:14:54 [auto1.de] INFO: Scrape type for AR79819: 2
2026-03-28 11:14:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819
2026-03-28 11:14:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with scrape type 2
2026-03-28 11:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with scrape type 2
2026-03-28 11:14:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f48bcb96-79e0-5a94-aa7e-0b74b41c6676, identifier: AR79819
2026-03-28 11:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:14:54 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-28 11:14:54 [auto1.de] INFO: Scrape type for YU21879: 2
2026-03-28 11:14:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879
2026-03-28 11:14:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with scrape type 2
2026-03-28 11:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with scrape type 2
2026-03-28 11:14:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c849ee50-57bc-5110-9c4a-d1eb0e5ade48, identifier: YU21879
2026-03-28 11:14:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819
2026-03-28 11:14:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819
2026-03-28 11:14:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f48bcb96-79e0-5a94-aa7e-0b74b41c6676 with identifier: AR79819 to the API
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:03:15Z',
 'fuel_type': 'diesel',
 'id': 'f48bcb96-79e0-5a94-aa7e-0b74b41c6676',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR79819',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 201775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-11',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-28 11:14:54 [auto1.de] INFO: Saving data for AR79819: {'auction_closing_time': 1774713795.0, 'created_time': 1773831137.132372, 'last_price_update_time': 1774696494.950004}
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR79819') HTTP/1.1" 204 0
2026-03-28 11:14:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879
2026-03-28 11:14:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879
2026-03-28 11:14:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c849ee50-57bc-5110-9c4a-d1eb0e5ade48 with identifier: YU21879 to the API
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:10:35Z',
 'fuel_type': 'diesel',
 'id': 'c849ee50-57bc-5110-9c4a-d1eb0e5ade48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU21879',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 272863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-28 11:14:55 [auto1.de] INFO: Saving data for YU21879: {'auction_closing_time': 1774714235.0, 'created_time': 1773230155.984021, 'last_price_update_time': 1774696495.290809}
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU21879') HTTP/1.1" 204 0
2026-03-28 11:14:55 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-28 11:14:55 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-28 11:14:55 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-28 11:14:55 [auto1.de] INFO: Scrape type for EL90308: 2
2026-03-28 11:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308
2026-03-28 11:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f652e903-b139-5056-98e1-d42b447e55eb with scrape type 2
2026-03-28 11:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f652e903-b139-5056-98e1-d42b447e55eb with scrape type 2
2026-03-28 11:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f652e903-b139-5056-98e1-d42b447e55eb, identifier: EL90308
2026-03-28 11:14:55 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-28 11:14:55 [auto1.de] INFO: Scrape type for VX14305: 2
2026-03-28 11:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305
2026-03-28 11:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f39087bf-9e2e-5b16-809a-b3173873d7fe with scrape type 2
2026-03-28 11:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f39087bf-9e2e-5b16-809a-b3173873d7fe with scrape type 2
2026-03-28 11:14:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f39087bf-9e2e-5b16-809a-b3173873d7fe, identifier: VX14305
2026-03-28 11:14:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308
2026-03-28 11:14:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308
2026-03-28 11:14:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f652e903-b139-5056-98e1-d42b447e55eb with identifier: EL90308 to the API
2026-03-28 11:14:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:47:15Z',
 'fuel_type': 'diesel',
 'id': 'f652e903-b139-5056-98e1-d42b447e55eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL90308',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 152943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-25',
 'seller_name': None,
 'title': 'Opel Meriva 1.3 CDTI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-28 11:14:56 [auto1.de] INFO: Saving data for EL90308: {'auction_closing_time': 1774716435.0, 'created_time': 1773136515.237769, 'last_price_update_time': 1774696496.359061}
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL90308') HTTP/1.1" 204 0
2026-03-28 11:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305
2026-03-28 11:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305
2026-03-28 11:14:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f39087bf-9e2e-5b16-809a-b3173873d7fe with identifier: VX14305 to the API
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:36:15Z',
 'fuel_type': 'petrol',
 'id': 'f39087bf-9e2e-5b16-809a-b3173873d7fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX14305',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 80422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-28 11:14:56 [auto1.de] INFO: Saving data for VX14305: {'auction_closing_time': 1774715775.0, 'created_time': 1773381502.143565, 'last_price_update_time': 1774696496.709176}
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX14305') HTTP/1.1" 204 0
2026-03-28 11:14:56 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-28 11:14:56 [auto1.de] INFO: Scrape type for GV00084: 2
2026-03-28 11:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084
2026-03-28 11:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with scrape type 2
2026-03-28 11:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with scrape type 2
2026-03-28 11:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6, identifier: GV00084
2026-03-28 11:14:56 [auto1.de] INFO: Channel: 24h | Page: 242 | totalHits: 9715 | hits on page: 40
2026-03-28 11:14:56 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-28 11:14:56 [auto1.de] INFO: Scrape type for BP39068: 2
2026-03-28 11:14:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068
2026-03-28 11:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f56b8c1-1690-5501-80f2-acef6636981e with scrape type 2
2026-03-28 11:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f56b8c1-1690-5501-80f2-acef6636981e with scrape type 2
2026-03-28 11:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f56b8c1-1690-5501-80f2-acef6636981e, identifier: BP39068
2026-03-28 11:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084
2026-03-28 11:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084
2026-03-28 11:14:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb777bb0-50dc-5dcf-8f94-81f9a66d26b6 with identifier: GV00084 to the API
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:15:54Z',
 'fuel_type': 'diesel',
 'id': 'fb777bb0-50dc-5dcf-8f94-81f9a66d26b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV00084',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 123712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-24',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-28 11:14:57 [auto1.de] INFO: Saving data for GV00084: {'auction_closing_time': 1774714554.0, 'created_time': 1774002225.84921, 'last_price_update_time': 1774696497.214654}
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV00084') HTTP/1.1" 204 0
2026-03-28 11:14:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068
2026-03-28 11:14:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068
2026-03-28 11:14:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f56b8c1-1690-5501-80f2-acef6636981e with identifier: BP39068 to the API
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:51:29Z',
 'fuel_type': 'diesel',
 'id': '2f56b8c1-1690-5501-80f2-acef6636981e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP39068',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NP300 Pick-up',
 'odometer': 248615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'Nissan NP300 Pick-up 2.3 dCi N-Connecta Double Cab 4x4',
 'transmission': 'manual',
 'trim': 'N-Connecta Double Cab 4x4',
 'year': 2017}
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-28 11:14:57 [auto1.de] INFO: Saving data for BP39068: {'auction_closing_time': 1774716689.0, 'created_time': 1774608597.100698, 'last_price_update_time': 1774696497.719494}
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP39068') HTTP/1.1" 204 0
2026-03-28 11:14:57 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-28 11:14:57 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-28 11:14:57 [auto1.de] INFO: Scrape type for MH67551: 2
2026-03-28 11:14:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551
2026-03-28 11:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a775d95-122c-5cc6-afc1-2c51c9555770 with scrape type 2
2026-03-28 11:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a775d95-122c-5cc6-afc1-2c51c9555770 with scrape type 2
2026-03-28 11:14:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a775d95-122c-5cc6-afc1-2c51c9555770, identifier: MH67551
2026-03-28 11:14:57 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-28 11:14:57 [auto1.de] INFO: Scrape type for ZT05209: 2
2026-03-28 11:14:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209
2026-03-28 11:14:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with scrape type 2
2026-03-28 11:14:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with scrape type 2
2026-03-28 11:14:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea43bf3f-14e4-5c4b-be29-baceb9ab1174, identifier: ZT05209
2026-03-28 11:14:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:14:58 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-28 11:14:58 [auto1.de] INFO: Scrape type for SK60410: 2
2026-03-28 11:14:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410
2026-03-28 11:14:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dddee70d-734a-5a90-beda-406fde31c029 with scrape type 2
2026-03-28 11:14:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dddee70d-734a-5a90-beda-406fde31c029 with scrape type 2
2026-03-28 11:14:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dddee70d-734a-5a90-beda-406fde31c029, identifier: SK60410
2026-03-28 11:14:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551
2026-03-28 11:14:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551
2026-03-28 11:14:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a775d95-122c-5cc6-afc1-2c51c9555770 with identifier: MH67551 to the API
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:41:41Z',
 'fuel_type': 'diesel',
 'id': '1a775d95-122c-5cc6-afc1-2c51c9555770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH67551',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 145093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-19',
 'seller_name': None,
 'title': 'Skoda Roomster 1.9 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-28 11:14:58 [auto1.de] INFO: Saving data for MH67551: {'auction_closing_time': 1774716101.0, 'created_time': 1774350356.484311, 'last_price_update_time': 1774696498.485615}
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH67551') HTTP/1.1" 204 0
2026-03-28 11:14:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209
2026-03-28 11:14:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209
2026-03-28 11:14:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea43bf3f-14e4-5c4b-be29-baceb9ab1174 with identifier: ZT05209 to the API
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:00:16Z',
 'fuel_type': 'petrol',
 'id': 'ea43bf3f-14e4-5c4b-be29-baceb9ab1174',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT05209',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 154341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-19',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.4 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2012}
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-28 11:14:58 [auto1.de] INFO: Saving data for ZT05209: {'auction_closing_time': 1774713616.0, 'created_time': 1773946598.484195, 'last_price_update_time': 1774696498.767884}
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT05209') HTTP/1.1" 204 0
2026-03-28 11:14:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410
2026-03-28 11:14:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410
2026-03-28 11:14:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dddee70d-734a-5a90-beda-406fde31c029 with identifier: SK60410 to the API
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:59:31Z',
 'fuel_type': 'diesel',
 'id': 'dddee70d-734a-5a90-beda-406fde31c029',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK60410',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 205170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-01',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-28 11:14:59 [auto1.de] INFO: Saving data for SK60410: {'auction_closing_time': 1774717171.0, 'created_time': 1774608668.356028, 'last_price_update_time': 1774696499.041304}
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK60410') HTTP/1.1" 204 0
2026-03-28 11:14:59 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-28 11:14:59 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-28 11:14:59 [auto1.de] INFO: Scrape type for HN51683: 2
2026-03-28 11:14:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683
2026-03-28 11:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef40ab49-c4ee-54d1-b189-3b30df34a458 with scrape type 2
2026-03-28 11:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef40ab49-c4ee-54d1-b189-3b30df34a458 with scrape type 2
2026-03-28 11:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef40ab49-c4ee-54d1-b189-3b30df34a458, identifier: HN51683
2026-03-28 11:14:59 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-28 11:14:59 [auto1.de] INFO: Scrape type for SY84491: 2
2026-03-28 11:14:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491
2026-03-28 11:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c606a5ed-6074-5be9-b0dd-3bdd335275ff with scrape type 2
2026-03-28 11:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c606a5ed-6074-5be9-b0dd-3bdd335275ff with scrape type 2
2026-03-28 11:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c606a5ed-6074-5be9-b0dd-3bdd335275ff, identifier: SY84491
2026-03-28 11:14:59 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-28 11:14:59 [auto1.de] INFO: Scrape type for XS67256: 2
2026-03-28 11:14:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256
2026-03-28 11:14:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e527202-c413-5ec0-8f06-997fa5d36237 with scrape type 2
2026-03-28 11:14:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e527202-c413-5ec0-8f06-997fa5d36237 with scrape type 2
2026-03-28 11:14:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e527202-c413-5ec0-8f06-997fa5d36237, identifier: XS67256
2026-03-28 11:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683
2026-03-28 11:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683
2026-03-28 11:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef40ab49-c4ee-54d1-b189-3b30df34a458 with identifier: HN51683 to the API
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:14:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:59:23Z',
 'fuel_type': 'petrol',
 'id': 'ef40ab49-c4ee-54d1-b189-3b30df34a458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN51683',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 95167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-28 11:14:59 [auto1.de] INFO: Saving data for HN51683: {'auction_closing_time': 1774717163.0, 'created_time': 1774034602.752146, 'last_price_update_time': 1774696499.75183}
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN51683') HTTP/1.1" 204 0
2026-03-28 11:14:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491
2026-03-28 11:14:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491
2026-03-28 11:14:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c606a5ed-6074-5be9-b0dd-3bdd335275ff with identifier: SY84491 to the API
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:14:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:39:00Z',
 'fuel_type': 'diesel',
 'id': 'c606a5ed-6074-5be9-b0dd-3bdd335275ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY84491',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 144335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-14',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2016}
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Saving data for SY84491: {'auction_closing_time': 1774715940.0, 'created_time': 1773917401.929951, 'last_price_update_time': 1774696500.173681}
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY84491') HTTP/1.1" 204 0
2026-03-28 11:15:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256
2026-03-28 11:15:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256
2026-03-28 11:15:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e527202-c413-5ec0-8f06-997fa5d36237 with identifier: XS67256 to the API
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:15:48Z',
 'fuel_type': 'petrol',
 'id': '3e527202-c413-5ec0-8f06-997fa5d36237',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS67256',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500C',
 'odometer': 189175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Fiat 500C 0.9 TwinAir Plus',
 'transmission': 'manual',
 'trim': 'TwinAir Plus',
 'year': 2011}
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Saving data for XS67256: {'auction_closing_time': 1774714548.0, 'created_time': 1774350402.095544, 'last_price_update_time': 1774696500.55645}
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS67256') HTTP/1.1" 204 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for VT53198: 2
2026-03-28 11:15:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198
2026-03-28 11:15:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with scrape type 2
2026-03-28 11:15:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with scrape type 2
2026-03-28 11:15:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48, identifier: VT53198
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for ZU82600: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for XL56937: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for AS68475: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for EE25450: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for WR57027: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for RW32541: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for MB99639: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for YF85970: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for KK39591: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for PA91230: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for MK66887: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for PS74193: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for LR74805: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for PR32105: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for JZ77748: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-28 11:15:00 [auto1.de] INFO: Scrape type for PC54286: 0
2026-03-28 11:15:00 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-28 11:15:01 [auto1.de] INFO: Scrape type for SD36670: 0
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-28 11:15:01 [auto1.de] INFO: Scrape type for TZ67975: 0
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-28 11:15:01 [auto1.de] INFO: Scrape type for VA13792: 0
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-28 11:15:01 [auto1.de] INFO: Scrape type for HX49915: 0
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-28 11:15:01 [auto1.de] INFO: Scrape type for GA34239: 0
2026-03-28 11:15:01 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-28 11:15:01 [auto1.de] INFO: Scrape type for CS24568: 2
2026-03-28 11:15:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568
2026-03-28 11:15:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03179b01-338a-57da-85c5-d3dbbdb45cd8 with scrape type 2
2026-03-28 11:15:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03179b01-338a-57da-85c5-d3dbbdb45cd8 with scrape type 2
2026-03-28 11:15:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03179b01-338a-57da-85c5-d3dbbdb45cd8, identifier: CS24568
2026-03-28 11:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198
2026-03-28 11:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198
2026-03-28 11:15:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b6e3121-8dbd-5e1c-a140-0b9930acfd48 with identifier: VT53198 to the API
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:51:03Z',
 'fuel_type': 'diesel',
 'id': '5b6e3121-8dbd-5e1c-a140-0b9930acfd48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT53198',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 159952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-12',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-28 11:15:01 [auto1.de] INFO: Saving data for VT53198: {'auction_closing_time': 1774716663.0, 'created_time': 1774608666.337759, 'last_price_update_time': 1774696501.627971}
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT53198') HTTP/1.1" 204 0
2026-03-28 11:15:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568
2026-03-28 11:15:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568
2026-03-28 11:15:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03179b01-338a-57da-85c5-d3dbbdb45cd8 with identifier: CS24568 to the API
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:01:37Z',
 'fuel_type': 'petrol',
 'id': '03179b01-338a-57da-85c5-d3dbbdb45cd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS24568',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 68574,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-10-24',
 'seller_name': None,
 'title': 'Cupra Leon 2.0 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-28 11:15:02 [auto1.de] INFO: Saving data for CS24568: {'auction_closing_time': 1774713697.0, 'created_time': 1774035480.243479, 'last_price_update_time': 1774696502.088816}
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS24568') HTTP/1.1" 204 0
2026-03-28 11:15:02 [auto1.de] INFO: Found listing with ID: AY50267
2026-03-28 11:15:02 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-28 11:15:02 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-28 11:15:02 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-28 11:15:02 [auto1.de] INFO: Scrape type for XX92411: 2
2026-03-28 11:15:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411
2026-03-28 11:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e621235e-95f2-5302-a01d-6bf9f14bb7f8 with scrape type 2
2026-03-28 11:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e621235e-95f2-5302-a01d-6bf9f14bb7f8 with scrape type 2
2026-03-28 11:15:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e621235e-95f2-5302-a01d-6bf9f14bb7f8, identifier: XX92411
2026-03-28 11:15:02 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-28 11:15:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411
2026-03-28 11:15:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411
2026-03-28 11:15:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e621235e-95f2-5302-a01d-6bf9f14bb7f8 with identifier: XX92411 to the API
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:38:30Z',
 'fuel_type': 'diesel',
 'id': 'e621235e-95f2-5302-a01d-6bf9f14bb7f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX92411',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 13504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-29',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI PRO',
 'transmission': 'automatic',
 'trim': 'PRO',
 'year': 2024}
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-28 11:15:02 [auto1.de] INFO: Saving data for XX92411: {'auction_closing_time': 1774715910.0, 'created_time': 1774608612.086118, 'last_price_update_time': 1774696502.56083}
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX92411') HTTP/1.1" 204 0
2026-03-28 11:15:02 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-28 11:15:02 [auto1.de] INFO: Scrape type for PD95192: 2
2026-03-28 11:15:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192
2026-03-28 11:15:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with scrape type 2
2026-03-28 11:15:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with scrape type 2
2026-03-28 11:15:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb, identifier: PD95192
2026-03-28 11:15:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192
2026-03-28 11:15:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192
2026-03-28 11:15:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb with identifier: PD95192 to the API
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-28T16:10:00Z',
 'fuel_type': 'petrol',
 'id': 'b6bbd9fe-63ca-5583-b23b-c2578d2d9ebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD95192',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 262858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-02',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2009}
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-28 11:15:03 [auto1.de] INFO: Saving data for PD95192: {'auction_closing_time': 1774714200.0, 'created_time': 1773230521.43815, 'last_price_update_time': 1774696503.020293}
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD95192') HTTP/1.1" 204 0
2026-03-28 11:15:03 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-28 11:15:03 [auto1.de] INFO: Scrape type for NY45710: 2
2026-03-28 11:15:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710
2026-03-28 11:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e1c178-7256-522c-a1ef-c7ba89be420c with scrape type 2
2026-03-28 11:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55e1c178-7256-522c-a1ef-c7ba89be420c with scrape type 2
2026-03-28 11:15:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55e1c178-7256-522c-a1ef-c7ba89be420c, identifier: NY45710
2026-03-28 11:15:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710
2026-03-28 11:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710
2026-03-28 11:15:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55e1c178-7256-522c-a1ef-c7ba89be420c with identifier: NY45710 to the API
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:37:28Z',
 'fuel_type': 'diesel',
 'id': '55e1c178-7256-522c-a1ef-c7ba89be420c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY45710',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 110885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-03',
 'seller_name': None,
 'title': 'Audi Q2 35 TDI quattro advanced',
 'transmission': 'automatic',
 'trim': 'quattro advanced',
 'year': 2022}
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-28 11:15:03 [auto1.de] INFO: Saving data for NY45710: {'auction_closing_time': 1774715848.0, 'created_time': 1774035460.117756, 'last_price_update_time': 1774696503.450837}
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY45710') HTTP/1.1" 204 0
2026-03-28 11:15:03 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-28 11:15:03 [auto1.de] INFO: Scrape type for GV20028: 2
2026-03-28 11:15:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028
2026-03-28 11:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3136b3ae-e420-5266-906c-a11d1d526dfd with scrape type 2
2026-03-28 11:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3136b3ae-e420-5266-906c-a11d1d526dfd with scrape type 2
2026-03-28 11:15:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3136b3ae-e420-5266-906c-a11d1d526dfd, identifier: GV20028
2026-03-28 11:15:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028
2026-03-28 11:15:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028
2026-03-28 11:15:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3136b3ae-e420-5266-906c-a11d1d526dfd with identifier: GV20028 to the API
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:32:23Z',
 'fuel_type': 'diesel',
 'id': '3136b3ae-e420-5266-906c-a11d1d526dfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV20028',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 234382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-28 11:15:03 [auto1.de] INFO: Saving data for GV20028: {'auction_closing_time': 1774715543.0, 'created_time': 1774349872.15789, 'last_price_update_time': 1774696503.914485}
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV20028') HTTP/1.1" 204 0
2026-03-28 11:15:03 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-28 11:15:03 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-28 11:15:03 [auto1.de] INFO: Scrape type for ZV16812: 2
2026-03-28 11:15:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812
2026-03-28 11:15:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6edd53f7-01e8-545c-81f6-f90a66a24b4d with scrape type 2
2026-03-28 11:15:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6edd53f7-01e8-545c-81f6-f90a66a24b4d with scrape type 2
2026-03-28 11:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6edd53f7-01e8-545c-81f6-f90a66a24b4d, identifier: ZV16812
2026-03-28 11:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812
2026-03-28 11:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812
2026-03-28 11:15:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6edd53f7-01e8-545c-81f6-f90a66a24b4d with identifier: ZV16812 to the API
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:23:57Z',
 'fuel_type': 'petrol',
 'id': '6edd53f7-01e8-545c-81f6-f90a66a24b4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV16812',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 143767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-07',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-28 11:15:04 [auto1.de] INFO: Saving data for ZV16812: {'auction_closing_time': 1774715037.0, 'created_time': 1773945887.9383, 'last_price_update_time': 1774696504.434266}
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV16812') HTTP/1.1" 204 0
2026-03-28 11:15:04 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-28 11:15:04 [auto1.de] INFO: Scrape type for CF89653: 2
2026-03-28 11:15:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653
2026-03-28 11:15:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 002da1e5-5e02-52ba-8992-d13c635d9cd1 with scrape type 2
2026-03-28 11:15:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 002da1e5-5e02-52ba-8992-d13c635d9cd1 with scrape type 2
2026-03-28 11:15:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 002da1e5-5e02-52ba-8992-d13c635d9cd1, identifier: CF89653
2026-03-28 11:15:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653
2026-03-28 11:15:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653
2026-03-28 11:15:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 002da1e5-5e02-52ba-8992-d13c635d9cd1 with identifier: CF89653 to the API
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:56:53Z',
 'fuel_type': 'diesel',
 'id': '002da1e5-5e02-52ba-8992-d13c635d9cd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF89653',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 144065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-09',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-28 11:15:04 [auto1.de] INFO: Saving data for CF89653: {'auction_closing_time': 1774717013.0, 'created_time': 1774035057.384842, 'last_price_update_time': 1774696504.913054}
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF89653') HTTP/1.1" 204 0
2026-03-28 11:15:05 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-28 11:15:05 [auto1.de] INFO: Scrape type for HD43211: 2
2026-03-28 11:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211
2026-03-28 11:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3259a4b6-7924-535d-a451-d944153ac8f9 with scrape type 2
2026-03-28 11:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3259a4b6-7924-535d-a451-d944153ac8f9 with scrape type 2
2026-03-28 11:15:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3259a4b6-7924-535d-a451-d944153ac8f9, identifier: HD43211
2026-03-28 11:15:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211
2026-03-28 11:15:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211
2026-03-28 11:15:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3259a4b6-7924-535d-a451-d944153ac8f9 with identifier: HD43211 to the API
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:30:55Z',
 'fuel_type': 'petrol',
 'id': '3259a4b6-7924-535d-a451-d944153ac8f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD43211',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 170957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 TGDI Style 4WD',
 'transmission': 'automatic',
 'trim': 'Style 4WD',
 'year': 2019}
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-28 11:15:05 [auto1.de] INFO: Saving data for HD43211: {'auction_closing_time': 1774715455.0, 'created_time': 1772545556.878691, 'last_price_update_time': 1774696505.476511}
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD43211') HTTP/1.1" 204 0
2026-03-28 11:15:05 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-28 11:15:05 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-28 11:15:05 [auto1.de] INFO: Scrape type for WX24181: 2
2026-03-28 11:15:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181
2026-03-28 11:15:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3dce4305-4e2e-592b-9d76-457ef84466cb with scrape type 2
2026-03-28 11:15:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3dce4305-4e2e-592b-9d76-457ef84466cb with scrape type 2
2026-03-28 11:15:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3dce4305-4e2e-592b-9d76-457ef84466cb, identifier: WX24181
2026-03-28 11:15:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181
2026-03-28 11:15:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181
2026-03-28 11:15:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3dce4305-4e2e-592b-9d76-457ef84466cb with identifier: WX24181 to the API
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:07:31Z',
 'fuel_type': 'diesel',
 'id': '3dce4305-4e2e-592b-9d76-457ef84466cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX24181',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 260478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Volvo V70 2.0 D4 Black Edition',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2015}
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-28 11:15:06 [auto1.de] INFO: Saving data for WX24181: {'auction_closing_time': 1774714051.0, 'created_time': 1773136167.446759, 'last_price_update_time': 1774696506.120292}
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX24181') HTTP/1.1" 204 0
2026-03-28 11:15:06 [auto1.de] INFO: Found listing with ID: KS08572
2026-03-28 11:15:06 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-28 11:15:06 [auto1.de] INFO: Scrape type for VE61397: 2
2026-03-28 11:15:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397
2026-03-28 11:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef57936-0030-5867-9342-add26f09c19f with scrape type 2
2026-03-28 11:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ef57936-0030-5867-9342-add26f09c19f with scrape type 2
2026-03-28 11:15:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ef57936-0030-5867-9342-add26f09c19f, identifier: VE61397
2026-03-28 11:15:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397
2026-03-28 11:15:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397
2026-03-28 11:15:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ef57936-0030-5867-9342-add26f09c19f with identifier: VE61397 to the API
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:39:35Z',
 'fuel_type': 'petrol',
 'id': '9ef57936-0030-5867-9342-add26f09c19f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE61397',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 64126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2021}
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-28 11:15:06 [auto1.de] INFO: Saving data for VE61397: {'auction_closing_time': 1774715975.0, 'created_time': 1774608692.028047, 'last_price_update_time': 1774696506.614643}
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE61397') HTTP/1.1" 204 0
2026-03-28 11:15:06 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-28 11:15:06 [auto1.de] INFO: Scrape type for GJ83963: 2
2026-03-28 11:15:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963
2026-03-28 11:15:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfab1721-fc06-5443-a90c-b5a9e8789030 with scrape type 2
2026-03-28 11:15:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfab1721-fc06-5443-a90c-b5a9e8789030 with scrape type 2
2026-03-28 11:15:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfab1721-fc06-5443-a90c-b5a9e8789030, identifier: GJ83963
2026-03-28 11:15:06 [scrapy.extensions.logstats] INFO: Crawled 458 pages (at 5 pages/min), scraped 1104 items (at 100 items/min)
2026-03-28 11:15:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-28 11:15:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963
2026-03-28 11:15:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963
2026-03-28 11:15:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfab1721-fc06-5443-a90c-b5a9e8789030 with identifier: GJ83963 to the API
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:15:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:15:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:19:09Z',
 'fuel_type': 'petrol',
 'id': 'cfab1721-fc06-5443-a90c-b5a9e8789030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ83963',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 205188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-09',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2018}
2026-03-28 11:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-28 11:15:07 [auto1.de] INFO: Saving data for GJ83963: {'auction_closing_time': 1774714749.0, 'created_time': 1774608728.563734, 'last_price_update_time': 1774696507.099709}
2026-03-28 11:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ83963') HTTP/1.1" 204 0
2026-03-28 11:15:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:15:09 [auto1.de] INFO: Channel: 24h | Page: 243 | totalHits: 9715 | hits on page: 35
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for GR15033: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for XN11461: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for HU88385: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for RN43410: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for UR77332: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for LJ04369: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: PV47280
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV47280%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for PV47280: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for SZ94185: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for YD94034: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for SG58590: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for SW86673: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for CJ06587: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: UY61545
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY61545%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for UY61545: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for DE56554: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for YE15667: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: MD24285
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: PZ15198
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ15198%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for PZ15198: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: CS43081
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS43081%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for CS43081: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: VK35465
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK35465%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for VK35465: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: XB83488
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB83488%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for XB83488: 0
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: PB97983
2026-03-28 11:15:09 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:15:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-28 11:15:09 [auto1.de] INFO: Scrape type for GX91022: 0
2026-03-28 11:15:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:15:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 11:15:26 [auto1.de] INFO: Channel: 24h | Page: 244 | totalHits: 9715 | hits on page: 0
2026-03-28 11:15:26 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 11:15:26 [auto1.de] INFO: auto1.de Batch config: batch 2/2
2026-03-28 11:15:26 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 4, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 20, <ScrapeType.BATCH_SKIPPED: 5>: 17}
2026-03-28 11:15:26 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1105 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_18_2026-03-28T10_35_00.jl
2026-03-28 11:15:26 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 2236681,
 'downloader/request_count': 1153,
 'downloader/request_method_count/GET': 907,
 'downloader/request_method_count/POST': 246,
 'downloader/response_bytes': 773739799,
 'downloader/response_count': 1153,
 'downloader/response_status_count/200': 1153,
 'dupefilter/filtered': 11,
 'elapsed_time_seconds': 2419.925615,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 11, 15, 26, 381207, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 1105,
 'log_count/DEBUG': 24132,
 'log_count/INFO': 29095,
 'memusage/max': 197558272,
 'memusage/startup': 147775488,
 'photo_download_count': 693,
 'request_depth_max': 247,
 'response_received_count': 460,
 'scheduler/dequeued': 1153,
 'scheduler/dequeued/memory': 1153,
 'scheduler/enqueued': 1153,
 'scheduler/enqueued/memory': 1153,
 'scrape_type/batch_skipped': 4878,
 'scrape_type/new': 106,
 'scrape_type/price_update': 999,
 'scrape_type/skipped': 3761,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 467,
 'scrapy-zyte-api/error_ratio': 0.014989293361884369,
 'scrapy-zyte-api/errors': 7,
 "scrapy-zyte-api/exception_types/<class 'aiohttp.client_exceptions.ClientConnectorError'>": 7,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 7.003142440254272,
 'scrapy-zyte-api/mean_response_seconds': 7.078617507429877,
 'scrapy-zyte-api/processed': 460,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 460,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 459,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 460,
 'scrapy-zyte-api/request_args/httpRequestBody': 246,
 'scrapy-zyte-api/request_args/httpRequestMethod': 246,
 'scrapy-zyte-api/request_args/httpResponseBody': 460,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 460,
 'scrapy-zyte-api/request_args/sessionContext': 460,
 'scrapy-zyte-api/request_args/url': 460,
 'scrapy-zyte-api/status_codes/0': 7,
 'scrapy-zyte-api/status_codes/200': 460,
 'scrapy-zyte-api/success': 460,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 9755,
 'source/total_available': 9715,
 'start_time': datetime.datetime(2026, 3, 28, 10, 35, 6, 455592, tzinfo=datetime.timezone.utc)}
2026-03-28 11:15:26 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 11:15:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f3aba79c390>
2026-03-28 11:15:26 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f3aba81dfd0>